00000001:02000400:3.0F:1788916691.485052:0:2957:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_hostid 00000001:02000400:3.0:1788916717.027957:0:3180:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1788916719.922587:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 264 MB/s 00000001:01000000:1.0F:1788916720.172463:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 911 MB/s 00000001:01000000:3.0:1788916720.425900:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6529 MB/s 00000020:02000000:1.0:1788916721.263244:0:3273:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.55_26_gfb964ff 00000400:02000000:2.0F:1788916722.692464:0:3288:0:(api-ni.c:2815:lnet_startup_lndni()) Added LNI 192.168.202.140@tcp [8/256/0/180] 00008000:02000000:2.0:1788916729.048682:0:3438:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788916794.391820:0:5240:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788916804.304785:0:5773:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788916804.304792:0:5773:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788916804.305108:0:5773:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000a5bb1100 00000080:02000400:2.0:1788916804.305119:0:5773:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788916804.312139:0:5773:0:(tgt_mount.c:2592:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788916804.312237:0:5773:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788916804.312315:0:5773:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a5d185c6) 00000020:00000080:2.0:1788916804.312337:0:5773:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788916804.328741:0:5773:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788916804.329317:0:5773:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788916804.352392:0:5773:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788916804.352434:0:5773:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788916804.352453:0:5773:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788916804.352505:0:5773:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788916804.352529:0:5773:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788916804.352974:0:5773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788916804.352982:0:5773:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788916804.352993:0:5773:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x51de7f756a83d3a1 00000020:01000004:2.0:1788916804.353003:0:5773:0:(tgt_mount.c:2677:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788916804.353007:0:5773:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788916804.353011:0:5773:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a5bb1100 from MGS 00000020:01000004:2.0:1788916804.353016:0:5773:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788916804.353025:0:5773:0:(genops.c:414:class_newdev()) Allocate new device MGS (00000000d2e40063) 00000020:00000080:2.0:1788916804.353035:0:5773:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788916804.353088:0:5773:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a5bb1100 from MGS, refs=2 00080000:01000000:2.0:1788916804.353093:0:5773:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788916804.353098:0:5773:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x51de7f756a83d3af 00000100:00100000:2.0:1788916804.353356:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788916804.353486:0:5773:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788916804.353499:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788916804.354524:0:5773:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788916804.354533:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788916804.355457:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788916804.355615:0:5773:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788916804.355622:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788916804.356581:0:5773:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788916804.356589:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788916804.356981:0:5773:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788916804.356989:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788916804.357709:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916804.357712:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916804.357714:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916804.358117:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916804.358129:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916804.358130:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916804.358808:0:5773:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788916804.364911:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788916804.608281:0:5773:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3383 MB/s 00000001:01000000:2.0:1788916804.863972:0:5773:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2909 MB/s 00000001:01000000:3.0:1788916805.114000:0:5773:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 535 MB/s 00000001:01000000:2.0:1788916805.363450:0:5773:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 983 MB/s 00080000:10000000:3.0:1788916805.371710:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1788916805.385443:0:5773:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788916805.385577:0:5773:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788916805.385580:0:5773:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788916805.386489:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788916805.386551:0:5773:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788916805.386600:0:5773:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788916805.386861:0:5773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788916805.386885:0:5773:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788916805.387307:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788916805.387567:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788916805.387572:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788916805.392611:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788916805.392660:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788916805.394544:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788916805.394556:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788916805.395527:0:5773:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788916805.395553:0:5773:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.140@tcp' 00000020:01000004:3.0:1788916805.395556:0:5773:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788916805.395612:0:5773:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.140@tcp (typ=mgc) 00000020:00000080:3.0:1788916805.395634:0:5773:0:(genops.c:414:class_newdev()) Allocate new device MGC192.168.202.140@tcp (0000000083b903a6) 00000020:00000080:3.0:1788916805.395652:0:5773:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788916805.395753:0:5773:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000019616229@MGC192.168.202.140@tcp: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1788916805.395985:0:5773:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.140@tcp-0 is initialized 00000040:01000000:3.0:1788916805.395992:0:5773:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788916805.397938:0:5789:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788916805.397985:0:5773:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.140@tcp (uuid 4933373a-b540-4420-bf34-9071e19d7373) 00000020:00000080:1.0:1788916805.398006:0:5773:0:(genops.c:1407:class_connect()) connect: client 4933373a-b540-4420-bf34-9071e19d7373, cookie 0x51de7f756a83d3bd 00000100:00080000:1.0:1788916805.398019:0:5773:0:(import.c:510:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788916805.398023:0:5773:0:(import.c:624:import_select_connection()) MGC192.168.202.140@tcp: import 0000000019616229 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1788916805.398066:0:5773:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d3bce880 x1875815140688000/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788916805.398105:0:5773:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4933373a-b540-4420-bf34-9071e19d7373->MGS 00000020:01000004:1.0:1788916805.398123:0:5773:0:(tgt_mount.c:1890:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788916805.398166:0:5773:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788916805.398187:0:5773:0:(genops.c:414:class_newdev()) Allocate new device MDS (00000000a46235da) 00000020:00000080:1.0:1788916805.398200:0:5773:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788916805.399208:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d3bce880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4933373a-b540-4420-bf34-9071e19d7373:3303:1875815140688000:0@lo:250: 00000100:00100000:3.0:1788916805.399316:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916805.399405:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140688000 00000100:00100000:3.0:1788916805.399413:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140688000 00000100:00100000:3.0:1788916805.399444:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788916805.399450:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000909b2d5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1875815140688000:12345-0@lo:250: 00010000:00080000:3.0:1788916805.399473:0:5784:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 4933373a-b540-4420-bf34-9071e19d7373@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:3.0:1788916805.399505:0:5784:0:(genops.c:1407:class_connect()) connect: client 4933373a-b540-4420-bf34-9071e19d7373, cookie 0x51de7f756a83d3cb 00000100:00080000:3.0:1788916805.399635:0:5784:0:(import.c:65:import_set_state_nolock()) 000000002a6c868c : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788916805.399692:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000909b2d5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+5:3303:x1875815140688000:12345-0@lo:250: Request processed in 241us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916805.399700:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788916805.399739:0:3303:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.140@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788916805.399745:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.140@tcp: connect to target with instance 0 00000100:00080000:3.0:1788916805.399752:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788916805.399755:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788916805.399757:0:3303:0:(import.c:65:import_set_state_nolock()) 0000000019616229 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788916805.399759:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788916805.399764:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788916805.399767:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d3bce880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4933373a-b540-4420-bf34-9071e19d7373:3303:1875815140688000:0@lo:250: 00000100:00080000:0.0:1788916805.400983:0:5788:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:3.0:1788916805.409548:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916805.452563:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788916805.452817:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788916805.452824:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788916805.457322:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788916805.460424:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788916805.468061:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788916805.468083:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788916805.472266:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788916805.472446:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788916805.472451:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788916805.472975:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788916805.472983:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788916805.528209:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788916805.528428:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788916805.528434:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788916805.530410:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788916805.530423:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788916805.531610:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788916805.531786:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788916805.531791:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788916805.532467:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788916805.532474:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788916805.533012:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788916805.533382:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788916805.533388:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788916805.533869:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788916805.533875:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788916805.534572:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788916805.534698:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788916805.534702:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788916805.535057:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788916805.535355:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788916805.571635:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788916805.571882:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788916805.571890:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788916805.573489:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788916805.573500:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788916805.574282:0:5773:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788916805.574291:0:5773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788916805.581304:0:5773:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788916805.581408:0:5773:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788916805.581416:0:5773:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788916805.581595:0:5773:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788916805.581634:0:5773:0:(tgt_mount.c:1493:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.140@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788916805.581639:0:5773:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788916805.581641:0:5773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788916805.581643:0:5773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788916805.581644:0:5773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788916805.581646:0:5773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788916805.581647:0:5773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788916805.581648:0:5773:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788916805.581650:0:5773:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788916805.581651:0:5773:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788916805.581652:0:5773:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788916805.581654:0:5773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788916805.581655:0:5773:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788916805.581657:0:5773:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788916805.581659:0:5773:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788916805.581661:0:5773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788916805.581662:0:5773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788916805.581663:0:5773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788916805.581664:0:5773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788916805.581665:0:5773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788916805.581666:0:5773:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788916805.581667:0:5773:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788916805.581668:0:5773:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788916805.581669:0:5773:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788916805.581670:0:5773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788916805.581671:0:5773:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788916805.581720:0:5773:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788916805.581741:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d44c972d pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140688128:0@lo:253: 00000100:00100000:3.0:1788916805.581844:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916805.581957:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 0000000063b60664 going to sleep for 11 seconds 00000100:00100000:0.0:1788916805.582137:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140688128 00000100:00100000:0.0:1788916805.582276:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140688128 00000100:00100000:2.0:1788916805.582521:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788916805.582532:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005bac4a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+5:5773:x1875815140688128:12345-0@lo:253: 20000000:01000000:2.0:1788916805.582595:0:5787:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788916805.582598:0:5787:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788916805.583576:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788916805.583654:0:5787:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788916805.584602:0:5787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788916805.585908:0:5809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788916805.588338:0:5787:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788916805.588347:0:5787:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788916805.588356:0:5787:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788916805.588360:0:5787:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788916805.588390:0:5787:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788916805.588927:0:5787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788916805.590392:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788916805.590965:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788916805.591064:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788916805.591120:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788916805.591302:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788916805.591628:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788916805.591640:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788916805.591685:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788916805.591693:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788916805.591723:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788916805.591729:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788916805.591822:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788916805.591870:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788916805.591911:0:5787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788916805.591918:0:5787:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788916805.591933:0:5787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788916805.592096:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788916805.592105:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788916805.592125:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788916805.592143:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788916805.592376:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788916805.592388:0:5787:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788916805.592551:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788916805.592560:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788916805.592596:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788916805.592616:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788916805.592633:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788916805.592641:0:5787:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788916805.592689:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788916805.592694:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788916805.592721:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788916805.592738:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788916805.593050:0:5787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788916805.593084:0:5787:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788916805.593090:0:5787:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788916805.593601:0:5810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788916805.598459:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788916805.598506:0:5787:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.140@tcp for mdt 20000000:01000000:2.0:1788916805.598510:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:2.0:1788916805.598549:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788916805.598557:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788916805.598607:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788916805.598617:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:2.0:1788916805.598690:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788916805.598702:0:5787:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788916805.598737:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788916805.598968:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788916805.599063:0:5787:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788916805.599068:0:5787:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788916805.599073:0:5787:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788916805.599090:0:5787:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788916805.599093:0:5787:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788916805.599129:0:5787:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788916805.599131:0:5787:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788916805.599740:0:5811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788916805.600047:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788916805.600078:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788916805.600095:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1788916805.600104:0:5787:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788916805.600114:0:5787:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788916805.600677:0:5812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788916805.600979:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788916805.601016:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788916805.601072:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1788916805.601084:0:5787:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788916805.601087:0:5787:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788916805.601093:0:5787:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788916805.601095:0:5787:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788916805.601102:0:5787:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788916805.601115:0:5787:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788916805.601743:0:5813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788916805.601914:0:5787:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788916805.614049:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788916805.614106:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788916805.614227:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788916805.614265:0:5787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788916805.614291:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d3d2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916805.614559:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d3d2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916805.614574:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d3d2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916805.614580:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d3d2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916805.614586:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d3d2 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916805.614593:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d3d2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916805.614600:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002e6dc8c2 already unused, calling callback (000000004701917a) 00010000:00010000:2.0:1788916805.614604:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d3d2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916805.614611:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d3d2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916805.614649:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d3d2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916805.614657:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d3d2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916805.614665:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d3d2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788916805.614684:0:5787:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788916805.924294:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005bac4a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+5:5773:x1875815140688128:12345-0@lo:253: Request processed in 341749us (342436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916805.924335:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788916805.924514:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d44c972d pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140688128:0@lo:253: 10000000:01000000:3.0:1788916805.924535:0:5773:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788916805.924539:0:5773:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788916805.924559:0:5773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788916805.924560:0:5773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788916805.924562:0:5773:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788916805.924563:0:5773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788916805.924564:0:5773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788916805.924566:0:5773:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788916805.924567:0:5773:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788916805.924569:0:5773:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788916805.924571:0:5773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788916805.924572:0:5773:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788916805.924596:0:5773:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a5bb1100 from lustre-MDT0000 10000000:01000000:3.0:1788916805.924631:0:5773:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788916805.924634:0:5773:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788916805.924640:0:5773:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a6e0a73b380 10000000:01000000:3.0:1788916805.924645:0:5773:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788916805.924655:0:5773:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a6e0a73b380 from 1 10000000:01000000:3.0:1788916805.924658:0:5773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788916805.924716:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 000000009242587a/0x51de7f756a83d3d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916805.924729:0:5773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 000000009242587a/0x51de7f756a83d3d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916805.924742:0:5773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 000000009242587a/0x51de7f756a83d3d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916805.924916:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d44c972d pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140688256:0@lo:101: 00000100:00100000:3.0:1788916805.924968:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916805.925093:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000879e73e4 going to sleep for 11 seconds 00000100:00100000:0.0:1788916805.925244:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140688256 00000100:00100000:0.0:1788916805.925255:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140688256 00000100:00100000:0.0:1788916805.925416:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788916805.925425:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000373dd48e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+5:5773:x1875815140688256:12345-0@lo:101: 00010000:00010000:0.0:1788916805.925444:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916805.925461:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eb3560ec/0x51de7f756a83d3e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d3d9 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916805.925488:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb3560ec/0x51de7f756a83d3e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d3d9 expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916805.925497:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eb3560ec/0x51de7f756a83d3e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d3d9 expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916805.925516:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eb3560ec, rc 0) 00000100:00100000:0.0:1788916805.925578:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000373dd48e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+6:5773:x1875815140688256:12345-0@lo:101: Request processed in 155us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916805.925584:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788916805.925651:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d44c972d pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140688256:0@lo:101: 00010000:00010000:1.0:1788916805.925664:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 000000009242587a/0x51de7f756a83d3d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d3e0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916805.925675:0:5773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 000000009242587a/0x51de7f756a83d3d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d3e0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916805.925730:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e8fae4be pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140688384:0@lo:501: 00000100:00100000:1.0:1788916805.925772:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916805.925965:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ca02bfab going to sleep for 11 seconds 00000100:00100000:3.0:1788916805.926034:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140688384 00000100:00100000:3.0:1788916805.926040:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140688384 00000100:00100000:3.0:1788916805.926063:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788916805.926069:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000574b1d87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+6:5773:x1875815140688384:12345-0@lo:501: 00000100:00100000:3.0:1788916805.926410:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000574b1d87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+6:5773:x1875815140688384:12345-0@lo:501: Request processed in 340us (636us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788916805.926417:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788916805.926513:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e8fae4be pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140688384:0@lo:501: 10000000:01000000:1.0:1788916805.926542:0:5773:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788916805.926560:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 000000009242587a/0x51de7f756a83d3d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d3e0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916805.926569:0:5773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 000000009242587a/0x51de7f756a83d3d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d3e0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916805.926579:0:5773:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a6e171d2800 10000000:01000000:1.0:1788916805.926584:0:5773:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788916805.926588:0:5773:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a6e171d2800 10000000:01000000:1.0:1788916805.926591:0:5773:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788916805.926594:0:5773:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9a6e171d2800 from 1 10000000:01000000:1.0:1788916805.926603:0:5773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788916805.926632:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 0000000004436c11/0x51de7f756a83d3e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916805.926639:0:5773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 0000000004436c11/0x51de7f756a83d3e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916805.926648:0:5773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 0000000004436c11/0x51de7f756a83d3e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916805.926662:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e8fae4be pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140688512:0@lo:101: 00000100:00100000:1.0:1788916805.926688:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916805.926710:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ca02bfab going to sleep for 11 seconds 00000100:00100000:3.0:1788916805.926971:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140688512 00000100:00100000:3.0:1788916805.926978:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140688512 00000100:00100000:3.0:1788916805.927004:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788916805.927011:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d545b479 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+6:5773:x1875815140688512:12345-0@lo:101: 00010000:00010000:3.0:1788916805.927021:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916805.927035:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ad95ef05/0x51de7f756a83d3ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d3e7 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916805.927056:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad95ef05/0x51de7f756a83d3ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d3e7 expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916805.927065:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ad95ef05/0x51de7f756a83d3ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d3e7 expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916805.927075:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ad95ef05, rc 0) 00000100:00100000:3.0:1788916805.927117:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d545b479 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+7:5773:x1875815140688512:12345-0@lo:101: Request processed in 107us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916805.927123:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788916805.927216:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e8fae4be pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140688512:0@lo:101: 00010000:00010000:1.0:1788916805.927241:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 0000000004436c11/0x51de7f756a83d3e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d3ee expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916805.927249:0:5773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 0000000004436c11/0x51de7f756a83d3e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d3ee expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916805.927263:0:5773:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788916805.927276:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 0000000004436c11/0x51de7f756a83d3e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d3ee expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916805.927282:0:5773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 0000000004436c11/0x51de7f756a83d3e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d3ee expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916805.927287:0:5773:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788916805.927291:0:5773:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788916805.927297:0:5773:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a6e171d2800 10000000:01000000:1.0:1788916805.927305:0:5773:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788916805.927319:0:5773:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788916805.927321:0:5773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788916805.927340:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 000000002e6ea87a/0x51de7f756a83d3f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916805.927346:0:5773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 000000002e6ea87a/0x51de7f756a83d3f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916805.927353:0:5773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 000000002e6ea87a/0x51de7f756a83d3f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916805.927365:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e8fae4be pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140688640:0@lo:101: 00000100:00100000:1.0:1788916805.927391:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916805.927408:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ca02bfab going to sleep for 11 seconds 00000100:00100000:3.0:1788916805.927516:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140688640 00000100:00100000:3.0:1788916805.927521:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140688640 00000100:00100000:3.0:1788916805.927539:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788916805.927545:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093bab822 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+7:5773:x1875815140688640:12345-0@lo:101: 00010000:00010000:3.0:1788916805.927552:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916805.927559:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000996bd662/0x51de7f756a83d3fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d3f5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916805.927582:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000996bd662/0x51de7f756a83d3fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d3f5 expref: 8 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916805.927591:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000996bd662/0x51de7f756a83d3fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d3f5 expref: 8 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916805.927596:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000996bd662, rc 0) 00000100:00100000:3.0:1788916805.927634:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093bab822 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+8:5773:x1875815140688640:12345-0@lo:101: Request processed in 90us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916805.927640:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788916805.927713:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e8fae4be pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140688640:0@lo:101: 00010000:00010000:1.0:1788916805.927724:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 000000002e6ea87a/0x51de7f756a83d3f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d3fc expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916805.927731:0:5773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 000000002e6ea87a/0x51de7f756a83d3f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d3fc expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916805.927789:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e8fae4be pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140688768:0@lo:501: 00000100:00100000:1.0:1788916805.927814:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916805.928005:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ca02bfab going to sleep for 11 seconds 00000100:00100000:0.0:1788916805.928175:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140688768 00000100:00100000:0.0:1788916805.928181:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140688768 00000100:00100000:3.0:1788916805.928295:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788916805.928303:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058b539ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+8:5773:x1875815140688768:12345-0@lo:501: 00000100:00100000:3.0:1788916805.928642:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058b539ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+9:5773:x1875815140688768:12345-0@lo:501: Request processed in 339us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916805.928649:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788916805.928896:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e8fae4be pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140688768:0@lo:501: 00000100:00100000:1.0:1788916805.928947:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e8fae4be pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140688896:0@lo:503: 00000100:00100000:1.0:1788916805.928989:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916805.929027:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ca02bfab going to sleep for 11 seconds 00000100:00100000:3.0:1788916805.929089:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140688896 00000100:00100000:3.0:1788916805.929094:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140688896 00000100:00100000:3.0:1788916805.929118:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788916805.929125:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3cb02e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+9:5773:x1875815140688896:12345-0@lo:503: 00000100:00100000:3.0:1788916805.929464:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3cb02e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+9:5773:x1875815140688896:12345-0@lo:503: Request processed in 339us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916805.929472:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788916805.929709:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e8fae4be pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140688896:0@lo:503: 00000100:00100000:3.0:1788916805.930516:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:5815:1875815140689024:0@lo:502: 00000100:00100000:3.0:1788916805.930577:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916805.930659:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set 000000009076dc2b going to sleep for 11 seconds 00000100:00100000:2.0:1788916805.930705:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140689024 00000100:00100000:2.0:1788916805.930712:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140689024 00000100:00100000:2.0:1788916805.930938:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788916805.930947:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094001c75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+9:5815:x1875815140689024:12345-0@lo:502: 00000100:00100000:2.0:1788916805.931211:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094001c75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+9:5815:x1875815140689024:12345-0@lo:502: Request processed in 265us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916805.931219:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788916805.931352:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:5815:1875815140689024:0@lo:502: 00000020:01000000:3.0:1788916805.931387:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788916805.931400:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788916805.931403:0:5815:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788916805.931408:0:5815:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788916805.931411:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788916805.931426:0:5815:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d01e543c) 00000020:00000080:3.0:1788916805.931447:0:5815:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788916805.931453:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788916805.931552:0:5815:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788916805.931562:0:5815:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x51de7f756a83d40a 00000020:00000080:3.0:1788916805.932030:0:5815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788916805.932036:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788916805.932040:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788916805.932042:0:5815:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788916805.932045:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788916805.932048:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788916805.932050:0:5815:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788916805.932053:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788916805.932061:0:5815:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000 (000000004f3873f0) 00000020:00000080:3.0:1788916805.932074:0:5815:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788916805.932078:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788916805.932080:0:5815:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788916805.932083:0:5815:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788916805.932090:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788916805.932177:0:5815:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a5bb1100 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788916805.932194:0:5815:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDD0000 (0000000084c0853f) 00000020:00000080:3.0:1788916805.932205:0:5815:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788916805.932301:0:5815:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788916805.932317:0:5815:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x51de7f756a83d41f 00000020:00000080:3.0:1788916805.932439:0:5815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788916805.932446:0:5815:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788916805.932451:0:5815:0:(genops.c:1407:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x51de7f756a83d426 00080000:01000000:3.0:1788916805.932457:0:5815:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788916805.932466:0:5815:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x51de7f756a83d42d 00080000:10000000:3.0:1788916805.933125:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788916805.933503:0:5815:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788916805.939030:0:5815:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1788916806.078114:0:5815:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1788916806.079872:0:5815:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1788916806.083434:0:5815:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788916806.084220:0:5815:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788916806.168422:0:5815:0:(genops.c:414:class_newdev()) Allocate new device lustre-QMT0000 (000000004cc76fb8) 00000020:00000080:1.0:1788916806.168460:0:5815:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788916806.168578:0:5815:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788916806.168586:0:5815:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x51de7f756a83d43b 00000020:00000080:0.0:1788916806.181562:0:5815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788916806.188325:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788916806.233500:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788916806.265341:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788916806.299863:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788916806.352062:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788916806.392474:0:5815:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1788916806.420250:0:5815:0:(genops.c:1407:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x51de7f756a83d442 00000020:00000080:0.0:1788916806.420682:0:5815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788916806.420697:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788916806.420704:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788916806.420706:0:5815:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788916806.420711:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788916806.420715:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788916806.420716:0:5815:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788916806.420719:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788916806.420720:0:5815:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788916806.420723:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788916806.420725:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788916806.420726:0:5815:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788916806.420728:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788916806.420732:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788916806.420733:0:5815:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788916806.420737:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788916806.420776:0:5815:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788916806.420867:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e1fe64d3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:5815:1875815140689152:0@lo:502: 00000100:00100000:0.0:1788916806.420974:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916806.421045:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set 00000000df56ee8b going to sleep for 11 seconds 00000100:00100000:1.0:1788916806.421121:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140689152 00000100:00100000:1.0:1788916806.421132:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140689152 00000100:00100000:1.0:1788916806.421213:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788916806.421233:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4b7ca91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+9:5815:x1875815140689152:12345-0@lo:502: 00000100:00100000:1.0:1788916806.421629:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4b7ca91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+9:5815:x1875815140689152:12345-0@lo:502: Request processed in 407us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916806.421638:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788916806.421761:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e1fe64d3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:5815:1875815140689152:0@lo:502: 00000020:01000000:2.0:1788916806.421793:0:5815:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788916806.421799:0:5815:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788916806.421800:0:5815:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788916806.421804:0:5815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788916806.421995:0:5773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788916806.422018:0:5773:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788916806.422043:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 000000002e6ea87a/0x51de7f756a83d3f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d3fc expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916806.422056:0:5773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 000000002e6ea87a/0x51de7f756a83d3f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d3fc expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916806.422065:0:5773:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a6e171d2800 from 1 10000000:01000000:1.0:1788916806.422068:0:5773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788916806.422104:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000f8db0532/0x51de7f756a83d449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916806.422113:0:5773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000f8db0532/0x51de7f756a83d449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916806.422134:0:5773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000f8db0532/0x51de7f756a83d449 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916806.422180:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e8fae4be pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140689280:0@lo:101: 00000100:00100000:1.0:1788916806.422219:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916806.422258:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 000000005a6d1ebc going to sleep for 11 seconds 00000100:00100000:2.0:1788916806.422351:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140689280 00000100:00100000:2.0:1788916806.422357:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140689280 00000100:00100000:2.0:1788916806.422391:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788916806.422405:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdcd5d62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+9:5773:x1875815140689280:12345-0@lo:101: 00010000:00010000:2.0:1788916806.422417:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916806.422434:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d450 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d449 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.422460:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d449 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.422470:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d449 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.422481:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002e6dc8c2, rc 0) 00000100:00100000:2.0:1788916806.422528:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdcd5d62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+10:5773:x1875815140689280:12345-0@lo:101: Request processed in 124us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916806.422534:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788916806.422717:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e8fae4be pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140689280:0@lo:101: 00010000:00010000:1.0:1788916806.422731:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000f8db0532/0x51de7f756a83d449 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d450 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916806.422739:0:5773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000f8db0532/0x51de7f756a83d449 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d450 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916806.423362:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e8fae4be pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140689408:0@lo:256: 00000100:00100000:1.0:1788916806.423435:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916806.423458:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 000000005a6d1ebc going to sleep for 11 seconds 00000100:00100000:2.0:1788916806.423629:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140689408 00000100:00100000:2.0:1788916806.423636:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140689408 00000100:00100000:2.0:1788916806.423667:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788916806.423674:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd16bf2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+10:5773:x1875815140689408:12345-0@lo:256: 20000000:01000000:2.0:1788916806.423694:0:5787:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788916806.423702:0:5787:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788916806.423776:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd16bf2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+10:5773:x1875815140689408:12345-0@lo:256: Request processed in 102us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916806.423783:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788916806.423971:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e8fae4be pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140689408:0@lo:256: 10000000:01000000:1.0:1788916806.424697:0:5773:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788916806.424720:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000f8db0532/0x51de7f756a83d449 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d450 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916806.424732:0:5773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 00000000f8db0532/0x51de7f756a83d449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d450 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916806.424741:0:5773:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e171d2800 from 1 10000000:01000000:1.0:1788916806.424745:0:5773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788916806.424798:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 000000003d5d5114/0x51de7f756a83d457 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916806.424806:0:5773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 000000003d5d5114/0x51de7f756a83d457 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916806.424818:0:5773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 000000003d5d5114/0x51de7f756a83d457 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916806.425452:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e8fae4be pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140689536:0@lo:101: 00000100:00100000:2.0:1788916806.425519:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916806.425601:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c2b6be07 going to sleep for 11 seconds 00000100:00100000:0.0:1788916806.425636:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140689536 00000100:00100000:0.0:1788916806.425646:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140689536 00000100:00100000:0.0:1788916806.425723:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788916806.425731:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfcaeb9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+10:5773:x1875815140689536:12345-0@lo:101: 00010000:00010000:0.0:1788916806.425747:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916806.425765:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c8cd0a2/0x51de7f756a83d45e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d457 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916806.425792:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c8cd0a2/0x51de7f756a83d45e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d457 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916806.425805:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c8cd0a2/0x51de7f756a83d45e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d457 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916806.425815:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c8cd0a2, rc 0) 00000100:00100000:0.0:1788916806.425897:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfcaeb9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+11:5773:x1875815140689536:12345-0@lo:101: Request processed in 166us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916806.425903:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788916806.426054:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e8fae4be pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140689536:0@lo:101: 00010000:00010000:2.0:1788916806.426081:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 000000003d5d5114/0x51de7f756a83d457 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d45e expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.426089:0:5773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 000000003d5d5114/0x51de7f756a83d457 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d45e expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916806.426263:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005e429bea pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140689664:0@lo:501: 00000100:00100000:2.0:1788916806.426293:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916806.426349:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c2b6be07 going to sleep for 11 seconds 00000100:00100000:0.0:1788916806.426418:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140689664 00000100:00100000:0.0:1788916806.426423:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140689664 00000100:00100000:0.0:1788916806.426450:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788916806.426455:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000baeee52b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+11:5773:x1875815140689664:12345-0@lo:501: 00000100:00100000:0.0:1788916806.427205:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000baeee52b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+11:5773:x1875815140689664:12345-0@lo:501: Request processed in 749us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916806.427215:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788916806.427437:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005e429bea pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140689664:0@lo:501: 00000100:00100000:2.0:1788916806.427476:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005e429bea pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140689792:0@lo:503: 00000100:00100000:2.0:1788916806.427521:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916806.427541:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c2b6be07 going to sleep for 11 seconds 00000100:00100000:3.0:1788916806.427593:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140689792 00000100:00100000:3.0:1788916806.427599:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140689792 00000100:00100000:3.0:1788916806.427638:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788916806.427644:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c78bb41e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+11:5773:x1875815140689792:12345-0@lo:503: 00000040:00080000:3.0:1788916806.427684:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788916806.427726:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c78bb41e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+11:5773:x1875815140689792:12345-0@lo:503: Request processed in 82us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916806.427732:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788916806.427892:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005e429bea pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140689792:0@lo:503: 00000040:00080000:2.0:1788916806.429381:0:5819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788916806.429600:0:5773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788916806.429622:0:5773:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788916806.429670:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 000000003d5d5114/0x51de7f756a83d457 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d45e expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916806.429684:0:5773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 000000003d5d5114/0x51de7f756a83d457 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d45e expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788916806.429746:0:5773:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788916806.429749:0:5773:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a6e171d2800 10000000:01000000:3.0:1788916806.429751:0:5773:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a6e171d2800 10000000:01000000:3.0:1788916806.429755:0:5773:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788916806.429762:0:5773:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a6e171d2800 from 1 10000000:01000000:3.0:1788916806.429765:0:5773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788916806.429808:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 0000000066768cbe/0x51de7f756a83d465 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916806.429907:0:5773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 0000000066768cbe/0x51de7f756a83d465 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916806.429920:0:5773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 0000000066768cbe/0x51de7f756a83d465 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916806.429946:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140689920:0@lo:101: 00000100:00100000:3.0:1788916806.430029:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916806.430085:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bcc6ae68 going to sleep for 11 seconds 00000100:00100000:0.0:1788916806.430172:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140689920 00000100:00100000:0.0:1788916806.430189:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140689920 00000100:00100000:0.0:1788916806.430323:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788916806.430333:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ab6f806 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+11:5773:x1875815140689920:12345-0@lo:101: 00010000:00010000:0.0:1788916806.430349:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916806.430364:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d5ecb114/0x51de7f756a83d46c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d465 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916806.430389:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d5ecb114/0x51de7f756a83d46c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d465 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916806.430398:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d5ecb114/0x51de7f756a83d46c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d465 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916806.430408:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d5ecb114, rc 0) 00000100:00100000:0.0:1788916806.430454:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ab6f806 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:5773:x1875815140689920:12345-0@lo:101: Request processed in 123us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916806.430461:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788916806.430558:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140689920:0@lo:101: 00010000:00010000:3.0:1788916806.430578:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 0000000066768cbe/0x51de7f756a83d465 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d46c expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916806.430586:0:5773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 0000000066768cbe/0x51de7f756a83d465 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d46c expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916806.430646:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140690048:0@lo:501: 00000100:00100000:3.0:1788916806.430669:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916806.430696:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bcc6ae68 going to sleep for 11 seconds 00000100:00100000:0.0:1788916806.430743:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140690048 00000100:00100000:0.0:1788916806.430748:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140690048 00000100:00100000:0.0:1788916806.430779:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788916806.430785:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000706f6cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+12:5773:x1875815140690048:12345-0@lo:501: 00000100:00100000:0.0:1788916806.431414:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000706f6cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+12:5773:x1875815140690048:12345-0@lo:501: Request processed in 627us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916806.431423:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1788916806.431673:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916806.431709:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140690048:0@lo:501: 00000100:00100000:3.0:1788916806.431743:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140690176:0@lo:503: 00000100:00100000:3.0:1788916806.431783:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916806.431900:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bcc6ae68 going to sleep for 11 seconds 00000100:00100000:0.0:1788916806.431941:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140690176 00000100:00100000:0.0:1788916806.431947:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140690176 00000100:00100000:0.0:1788916806.432014:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788916806.432021:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b8c63dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:5773:x1875815140690176:12345-0@lo:503: 00000100:00100000:0.0:1788916806.432527:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b8c63dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:5773:x1875815140690176:12345-0@lo:503: Request processed in 505us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916806.432541:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788916806.432615:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140690176:0@lo:503: 00000100:00100000:3.0:1788916806.433012:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:5820:1875815140690304:0@lo:502: 00000100:00100000:3.0:1788916806.433054:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916806.433178:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set 00000000704a12d1 going to sleep for 11 seconds 00000100:00100000:1.0:1788916806.433346:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140690304 00000100:00100000:1.0:1788916806.433353:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140690304 00000100:00100000:1.0:1788916806.433382:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788916806.433388:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d936e7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+12:5820:x1875815140690304:12345-0@lo:502: 00000100:00100000:1.0:1788916806.433619:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d936e7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+12:5820:x1875815140690304:12345-0@lo:502: Request processed in 230us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916806.433627:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788916806.433717:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:5820:1875815140690304:0@lo:502: 00000020:01000004:3.0:1788916806.433781:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788916806.433808:0:5820:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e4e15580) 00000020:00000080:3.0:1788916806.433847:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788916806.434067:0:5820:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a5bb1100 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788916806.434072:0:5820:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000a5bb1100 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788916806.434074:0:5820:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000a5bb1100 4 00010000:00080000:3.0:1788916806.434108:0:5820:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f033cda5@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1788916806.440504:0:5820:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788916806.440657:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788916806.440709:0:5820:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788916806.440725:0:5820:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x51de7f756a83d47a 00000100:00080000:3.0:1788916806.440740:0:5820:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788916806.440747:0:5820:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f033cda5 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1788916806.440804:0:5820:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000289fc6aa x1875815140690432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788916806.441947:0:5820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788916806.442317:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875815140690432:0@lo:38: 00000100:00100000:2.0:1788916806.442427:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916806.443994:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140690432 00000100:00100000:3.0:1788916806.444013:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140690432 00000100:00100000:3.0:1788916806.444073:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788916806.444082:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e429bea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875815140690432:12345-0@lo:38: 00000100:00100000:3.0:1788916806.444254:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e429bea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875815140690432:12345-0@lo:38: Request processed in 171us (1827us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788916806.444263:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788916806.444330:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788916806.444342:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000f033cda5 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788916806.444353:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788916806.444357:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875815140690432:0@lo:38: 00000100:00100000:3.0:1788916806.444498:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:5820:1875815140690560:0@lo:502: 00000100:00100000:3.0:1788916806.444552:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916806.444579:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140690560 00000100:00100000:3.0:1788916806.444582:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140690560 00000100:00100000:3.0:1788916806.444612:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788916806.444617:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d15fa735 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+12:5820:x1875815140690560:12345-0@lo:502: 00000100:00100000:3.0:1788916806.444992:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d15fa735 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+12:5820:x1875815140690560:12345-0@lo:502: Request processed in 374us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916806.444999:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788916806.445168:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a307c5a1 going to sleep for 11 seconds 00000100:00100000:3.0:1788916806.445184:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:5820:1875815140690560:0@lo:502: 00000040:00080000:3.0:1788916806.445209:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788916806.446486:0:5773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788916806.446518:0:5773:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788916806.446541:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 0000000066768cbe/0x51de7f756a83d465 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d46c expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.446554:0:5773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 0000000066768cbe/0x51de7f756a83d465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d46c expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788916806.446623:0:5773:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788916806.446631:0:5773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788916806.446633:0:5773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788916806.446634:0:5773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788916806.446635:0:5773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788916806.446636:0:5773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788916806.446637:0:5773:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788916806.446639:0:5773:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788916806.446641:0:5773:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788916806.446642:0:5773:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788916806.446644:0:5773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788916806.446645:0:5773:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788916806.446649:0:5773:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788916806.446651:0:5773:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788916806.446653:0:5773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788916806.446653:0:5773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788916806.446654:0:5773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788916806.446655:0:5773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788916806.446656:0:5773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788916806.446657:0:5773:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788916806.446658:0:5773:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788916806.446659:0:5773:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788916806.446659:0:5773:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788916806.446660:0:5773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788916806.446661:0:5773:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788916806.446695:0:5773:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788916806.446721:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003218b6aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140690688:0@lo:253: 00000100:00100000:2.0:1788916806.446798:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916806.446859:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e09790c2 going to sleep for 11 seconds 00000100:00100000:2.0:1788916806.446896:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140690688 00000100:00100000:2.0:1788916806.446905:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140690688 00000100:00100000:2.0:1788916806.446958:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788916806.446967:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc2e7561 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+12:5773:x1875815140690688:12345-0@lo:253: 20000000:01000000:2.0:1788916806.447024:0:5787:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788916806.447048:0:5787:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788916806.490702:0:5787:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788916806.490726:0:5787:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788916806.491710:0:5808:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788916806.491719:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788916806.491745:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d481 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916806.491770:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d450 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d449 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916806.491883:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d481 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916806.491939:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d450 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d449 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916806.491956:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d450 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d449 expref: 12 pid: 5787 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916806.492066:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5808:1875815140690816:0@lo:104: 00000100:00100000:3.0:1788916806.492198:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916806.492343:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140690816 00000100:00100000:2.0:1788916806.492360:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140690816 00000100:00100000:2.0:1788916806.492424:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788916806.492432:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5b06d7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+3:5808:x1875815140690816:12345-0@lo:104: 00010000:00010000:2.0:1788916806.492447:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: 00000000f8db0532/0x51de7f756a83d449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d450 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.492512:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788916806.492517:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5b06d7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+3:5808:x1875815140690816:12345-0@lo:104: Request processed in 86us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916806.492524:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788916806.492553:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788916806.492558:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 00000000f8db0532/0x51de7f756a83d449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d450 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.492565:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f8db0532 already unused, calling callback (000000002107a5f7) 10000000:00010000:2.0:1788916806.492568:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 00000000f8db0532/0x51de7f756a83d449 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d450 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.492575:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 00000000f8db0532/0x51de7f756a83d449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d450 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788916806.492581:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 00000000f8db0532/0x51de7f756a83d449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d450 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788916806.492586:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788916806.492618:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 00000000f8db0532/0x51de7f756a83d449 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d450 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.492625:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788916806.492645:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 00000000f8db0532/0x51de7f756a83d449 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d450 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.492658:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 00000000f8db0532/0x51de7f756a83d449 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d450 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.492680:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916806.492682:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916806.492684:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916806.492761:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000049ee6415 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140690944:0@lo:103: 00000100:00100000:2.0:1788916806.492808:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916806.493097:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140690944 00000100:00100000:2.0:1788916806.493102:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140690944 00010000:00010000:2.0:1788916806.493120:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d450 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d449 expref: 13 pid: 5787 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916806.493142:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788916806.493180:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000748cef22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+13:3305:x1875815140690944:12345-0@lo:103: 00010000:00010000:2.0:1788916806.493190:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916806.493195:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d450 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d449 expref: 13 pid: 5787 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.493206:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d450 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d449 expref: 13 pid: 5787 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.493241:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d481 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.493250:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d481 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788916806.493264:0:5777:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001547254s 00010000:00010000:2.0:1788916806.493275:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d481 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.493282:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d481 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.493289:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d481 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.493294:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d481 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.493300:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b85e54c4 already unused, calling callback (000000004701917a) 00010000:00010000:2.0:1788916806.493303:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d481 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.493310:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d481 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.493317:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d481 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916806.493329:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788916806.493357:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000748cef22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+13:3305:x1875815140690944:12345-0@lo:103: Request processed in 179us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916806.493364:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788916806.493415:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000049ee6415 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140690944:0@lo:103: 00000100:00100000:3.0:1788916806.493569:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set 000000002d024cd8 going to sleep for 11 seconds 00010000:00010000:3.0:1788916806.493583:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002e6dc8c2/0x51de7f756a83d450 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d449 expref: 12 pid: 5787 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916806.493594:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5808:1875815140690816:0@lo:104: 00010000:00010000:3.0:1788916806.493606:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d481 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916806.493614:0:5808:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d481 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916806.493620:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d481 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916806.493625:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d481 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916806.503282:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc2e7561 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+11:5773:x1875815140690688:12345-0@lo:253: Request processed in 56301us (56469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916806.503305:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788916806.503532:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003218b6aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:5773:1875815140690688:0@lo:253: 10000000:01000000:0.0:1788916806.503551:0:5773:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788916806.503555:0:5773:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788916806.503557:0:5773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788916806.503559:0:5773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788916806.503560:0:5773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788916806.503561:0:5773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788916806.503563:0:5773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788916806.503564:0:5773:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788916806.503565:0:5773:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788916806.503567:0:5773:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788916806.503569:0:5773:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788916806.503571:0:5773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788916806.503572:0:5773:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788916806.503605:0:5773:0:(tgt_mount.c:2781:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788916806.512695:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788916806.513660:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788916806.514080:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788916806.514525:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788916806.514743:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788916806.515080:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788916806.520474:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788916806.521388:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788916806.521687:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788916806.521941:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788916806.522622:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788916806.522927:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1788916806.581052:0:5773:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788916806.615216:0:5773:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788916806.615624:0:5826:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788916806.619970:0:5773:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000020:00080000:2.0:1788916806.620580:0:5825:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788916806.620587:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1788916806.620658:0:5773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788916806.621387:0:5773:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788916806.621402:0:5773:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788916806.621654:0:5773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788916806.623515:0:5773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788916806.624365:0:5773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788916806.624427:0:5773:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788916806.624804:0:5773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788916806.625778:0:5773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1788916806.628277:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788916806.628420:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788916806.628572:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788916806.628695:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788916806.628837:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788916806.628969:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788916806.629139:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788916806.629346:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788916806.629499:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788916806.629632:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788916806.629779:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788916806.629918:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788916806.630079:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788916806.631571:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788916806.631819:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788916806.633550:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788916806.634048:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788916806.634344:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788916806.634507:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788916806.634641:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788916806.634807:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788916806.635209:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788916806.635480:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788916806.635642:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788916806.635829:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788916806.636490:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788916806.636659:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788916806.636839:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788916806.637081:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788916806.637440:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788916806.637649:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788916806.637807:0:5773:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788916806.639833:0:5773:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788916806.764563:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788916806.836341:0:5773:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788916806.836399:0:5773:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1404188b988 00100000:10000000:3.0:1788916806.836410:0:5773:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788916806.837106:0:5773:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788916806.837129:0:5773:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788916806.837180:0:5773:0:(tgt_mount.c:2550:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788916806.837207:0:5773:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1788916806.894258:0:5826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788916806.894361:0:5826:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788916806.894366:0:5826:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788916807.455401:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916808.483649:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916809.505273:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916810.528615:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916811.558719:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788916811.812311:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788916811.812324:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788916811.812327:0:8:0:(import.c:65:import_set_state_nolock()) 00000000f033cda5 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788916811.812344:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f033cda5 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1788916811.812369:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000063835c9f x1875815140691200/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788916811.812414:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000063835c9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875815140691200:0@lo:38: 00000100:00100000:3.0:1788916811.812500:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916811.812763:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140691072:0@lo:400: 00000100:00100000:2.0:1788916811.812957:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916811.813054:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140691072 00000100:00100000:3.0:1788916811.813063:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140691072 00000100:00100000:3.0:1788916811.813265:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788916811.813275:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb061af7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+11:3306:x1875815140691072:12345-0@lo:400: 00000100:00100000:3.0:1788916811.813336:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb061af7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+11:3306:x1875815140691072:12345-0@lo:400: Request processed in 63us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916811.813345:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788916811.813399:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140691072:0@lo:400: 00000100:00100000:1.0:1788916811.813538:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140691200 00000100:00100000:1.0:1788916811.813544:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140691200 00000100:00100000:1.0:1788916811.813574:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788916811.813579:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa6155bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875815140691200:12345-0@lo:38: 00010000:00080000:1.0:1788916811.813607:0:5794:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:1.0:1788916811.814290:0:5794:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x51de7f756a83d488 00000004:00100000:1.0:1788916811.814348:0:5794:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788916811.814474:0:5794:0:(import.c:65:import_set_state_nolock()) 00000000474a5ce6 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788916811.814543:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa6155bb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875815140691200:12345-0@lo:38: Request processed in 962us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916811.814551:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788916811.814909:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000063835c9f x1875815140691200/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788916821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788916811.814941:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788916811.814951:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788916811.814957:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788916811.814959:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000f033cda5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788916811.814965:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000063835c9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875815140691200:0@lo:38: 00000001:02000400:2.0:1788916812.540921:0:6070:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788916812.575434:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916813.599416:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916814.623930:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788916814.881782:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788916814.881794:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a6e171d2800 from 3 10000000:01000000:2.0:1788916814.881801:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788916814.881861:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 00000000e43ccbb5/0x51de7f756a83d48f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916814.881886:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 00000000e43ccbb5/0x51de7f756a83d48f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916814.881899:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 00000000e43ccbb5/0x51de7f756a83d48f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916814.881931:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000049ee6415 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140691328:0@lo:101: 00000100:00100000:2.0:1788916814.882020:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916814.882076:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cbcf7c70 going to sleep for 11 seconds 00000100:00100000:2.0:1788916814.882104:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140691328 00000100:00100000:2.0:1788916814.882121:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140691328 00000100:00100000:2.0:1788916814.882207:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788916814.882216:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6c896e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+11:5789:x1875815140691328:12345-0@lo:101: 00010000:00010000:2.0:1788916814.882235:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916814.882250:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a24ece49/0x51de7f756a83d496 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d48f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916814.882285:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a24ece49/0x51de7f756a83d496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d48f expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916814.882297:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a24ece49/0x51de7f756a83d496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d48f expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916814.882309:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a24ece49, rc 0) 00000100:00100000:2.0:1788916814.882354:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6c896e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+12:5789:x1875815140691328:12345-0@lo:101: Request processed in 139us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916814.882362:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788916814.882416:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000049ee6415 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140691328:0@lo:101: 00010000:00010000:2.0:1788916814.882438:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 00000000e43ccbb5/0x51de7f756a83d48f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d496 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916814.882447:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 00000000e43ccbb5/0x51de7f756a83d48f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d496 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916814.882494:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000049ee6415 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140691456:0@lo:256: 00000100:00100000:2.0:1788916814.882521:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916814.882538:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cbcf7c70 going to sleep for 11 seconds 00000100:00100000:2.0:1788916814.882550:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140691456 00000100:00100000:2.0:1788916814.882553:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140691456 00000100:00100000:2.0:1788916814.882570:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788916814.882575:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005d6aeb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+12:5789:x1875815140691456:12345-0@lo:256: 20000000:01000000:2.0:1788916814.882590:0:5784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788916814.882608:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788916814.882611:0:5784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788916814.882693:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005d6aeb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+12:5789:x1875815140691456:12345-0@lo:256: Request processed in 117us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916814.882700:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788916814.882725:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000049ee6415 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140691456:0@lo:256: 10000000:01000000:2.0:1788916814.882759:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788916814.882764:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: 00000000e43ccbb5/0x51de7f756a83d48f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d496 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916814.882772:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: 00000000e43ccbb5/0x51de7f756a83d48f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d496 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916815.648218:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916816.674842:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916816.928103:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788916816.928141:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000063835c9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140691584:0@lo:400: 00000100:00100000:3.0:1788916816.928243:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916816.928305:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140691712:0@lo:400: 00000100:00100000:3.0:1788916816.928336:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916816.928382:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140691584 00000100:00100000:3.0:1788916816.928389:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140691584 00000100:00100000:3.0:1788916816.928515:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788916816.928527:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f270d1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:3306:x1875815140691584:12345-0@lo:400: 00000100:00100000:3.0:1788916816.928581:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f270d1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:3306:x1875815140691584:12345-0@lo:400: Request processed in 57us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916816.928589:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788916816.928622:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140691712 00000100:00100000:3.0:1788916816.928626:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140691712 00000100:00100000:3.0:1788916816.928653:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788916816.928659:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026605eea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140691712:12345-0@lo:400: 00000100:00100000:3.0:1788916816.928695:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026605eea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140691712:12345-0@lo:400: Request processed in 36us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916816.928700:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788916816.928739:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000289fc6aa x1875815140691712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916816.928769:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000289fc6aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140691712:0@lo:400: 00000100:00100000:3.0:1788916816.929359:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000063835c9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140691584:0@lo:400: 00010000:00010000:3.0:1788916817.702597:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916818.719402:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788916819.425727:0:6272:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec8dbde90 20000000:00000080:2.0:1788916819.425751:0:6272:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6e06ea8c00 uarg=0000000000000000 20000000:01000000:2.0:1788916819.426033:0:6272:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788916819.426043:0:6272:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788916819.426050:0:6272:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788916819.426437:0:6272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788916819.426454:0:6272:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788916819.436777:0:6272:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788916819.437095:0:6272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788916819.437225:0:6272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788916819.437278:0:6272:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788916819.437305:0:6272:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788916819.437331:0:6272:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d49d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916819.437357:0:6272:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003c8cd0a2/0x51de7f756a83d45e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d457 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916819.437365:0:6272:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d49d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916819.437416:0:6272:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003c8cd0a2/0x51de7f756a83d45e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d457 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916819.437435:0:6272:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003c8cd0a2/0x51de7f756a83d45e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d457 expref: 11 pid: 5787 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916819.437453:0:6272:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000063835c9f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6272:1875815140691840:0@lo:104: 00000100:00100000:3.0:1788916819.437543:0:6272:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916819.437677:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140691840 00000100:00100000:2.0:1788916819.437689:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140691840 00000100:00100000:2.0:1788916819.437771:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788916819.437780:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000289fc6aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+3:6272:x1875815140691840:12345-0@lo:104: 00010000:00010000:2.0:1788916819.438527:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: 000000003d5d5114/0x51de7f756a83d457 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d45e expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916819.438644:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788916819.438652:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000289fc6aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+3:6272:x1875815140691840:12345-0@lo:104: Request processed in 872us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916819.438662:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788916819.439083:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788916819.439090:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: 000000003d5d5114/0x51de7f756a83d457 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d45e expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916819.439099:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003d5d5114 already unused, calling callback (000000002107a5f7) 10000000:00010000:0.0:1788916819.439113:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: 000000003d5d5114/0x51de7f756a83d457 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d45e expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916819.439123:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: 000000003d5d5114/0x51de7f756a83d457 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d45e expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788916819.439130:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: 000000003d5d5114/0x51de7f756a83d457 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d45e expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788916819.439178:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788916819.439232:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: 000000003d5d5114/0x51de7f756a83d457 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d45e expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916819.439240:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788916819.439271:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: 000000003d5d5114/0x51de7f756a83d457 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d45e expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916819.439279:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: 000000003d5d5114/0x51de7f756a83d457 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d45e expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916819.439305:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916819.439306:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916819.439308:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916819.439329:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788916819.439350:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bf45385f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140691968:0@lo:103: 00000100:00100000:0.0:1788916819.439397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916819.439451:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140691968 00000100:00100000:0.0:1788916819.439459:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140691968 00010000:00010000:0.0:1788916819.439485:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003c8cd0a2/0x51de7f756a83d45e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d457 expref: 12 pid: 5787 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916819.439512:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788916819.439519:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aeccfbb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+12:3304:x1875815140691968:12345-0@lo:103: 00010000:00010000:0.0:1788916819.439533:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788916819.439538:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003c8cd0a2/0x51de7f756a83d45e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d457 expref: 12 pid: 5787 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916819.439547:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003c8cd0a2/0x51de7f756a83d45e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d457 expref: 12 pid: 5787 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916819.439576:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d49d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916819.439585:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d49d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916819.439602:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d49d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916819.439609:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d49d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916819.439615:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d49d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916819.439621:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d49d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916819.439626:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b85e54c4 already unused, calling callback (000000004701917a) 00010000:00010000:0.0:1788916819.439630:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d49d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916819.439637:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d49d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916819.439645:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d49d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916819.439655:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788916819.439685:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aeccfbb3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+12:3304:x1875815140691968:12345-0@lo:103: Request processed in 166us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916819.439700:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788916819.439745:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bf45385f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140691968:0@lo:103: 00000100:00100000:3.0:1788916819.452397:0:6272:0:(client.c:2702:ptlrpc_set_wait()) set 00000000da4d406a going to sleep for 11 seconds 00010000:00010000:3.0:1788916819.452515:0:6272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003c8cd0a2/0x51de7f756a83d45e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d457 expref: 11 pid: 5787 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916819.452573:0:6272:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000063835c9f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6272:1875815140691840:0@lo:104: 00010000:00010000:3.0:1788916819.452602:0:6272:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d49d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916819.452614:0:6272:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d49d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916819.452621:0:6272:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d49d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916819.452626:0:6272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d49d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916819.745418:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916820.769275:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916821.792573:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916822.047612:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007737c663 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140692096:0@lo:400: 00000100:00100000:3.0:1788916822.047726:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916822.047809:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788916822.047816:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000067e248e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140692224:0@lo:400: 00000100:00100000:3.0:1788916822.047849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916822.048207:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140692224 00000100:00100000:1.0:1788916822.048219:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140692224 00000100:00100000:1.0:1788916822.048285:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788916822.048295:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063835c9f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140692224:12345-0@lo:400: 00000100:00100000:1.0:1788916822.048374:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063835c9f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140692224:12345-0@lo:400: Request processed in 80us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916822.048382:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788916822.048512:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000067e248e7 x1875815140692224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916822.048530:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000067e248e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140692224:0@lo:400: 00000100:00100000:0.0:1788916822.049997:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140692096 00000100:00100000:0.0:1788916822.050014:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140692096 00000100:00100000:0.0:1788916822.050072:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788916822.050091:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e15962b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+11:3306:x1875815140692096:12345-0@lo:400: 00000100:00100000:0.0:1788916822.050197:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e15962b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+11:3306:x1875815140692096:12345-0@lo:400: Request processed in 107us (2471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916822.050205:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788916822.050467:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007737c663 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140692096:0@lo:400: 00010000:00010000:0.0:1788916822.833011:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788916822.882498:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788916822.882509:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e171d2800 from 1 10000000:01000000:1.0:1788916822.882516:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788916822.882587:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: 000000006a6ee4d7/0x51de7f756a83d4a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916822.882604:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: 000000006a6ee4d7/0x51de7f756a83d4a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916822.882616:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: 000000006a6ee4d7/0x51de7f756a83d4a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916822.882647:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007d95db78 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140692352:0@lo:101: 00000100:00100000:1.0:1788916822.882824:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916822.882932:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set 0000000060305719 going to sleep for 11 seconds 00000100:00100000:3.0:1788916822.886023:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140692352 00000100:00100000:3.0:1788916822.886041:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140692352 00000100:00100000:3.0:1788916822.886130:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788916822.886338:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001542164b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+11:5789:x1875815140692352:12345-0@lo:101: 00010000:00010000:3.0:1788916822.886370:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916822.886468:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d4ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d4a4 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916822.886511:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d4ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d4a4 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916822.890470:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b85e54c4/0x51de7f756a83d4ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d4a4 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916822.890489:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b85e54c4, rc 0) 00000100:00100000:3.0:1788916822.890630:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001542164b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+12:5789:x1875815140692352:12345-0@lo:101: Request processed in 4488us (7806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916822.890641:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788916822.890894:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007d95db78 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140692352:0@lo:101: 00010000:00010000:0.0:1788916822.890923:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: 000000006a6ee4d7/0x51de7f756a83d4a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d4ab expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916822.890935:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: 000000006a6ee4d7/0x51de7f756a83d4a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d4ab expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916822.891034:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bf45385f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140692480:0@lo:501: 00000100:00100000:0.0:1788916822.891089:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916822.891135:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ac07e7dd going to sleep for 11 seconds 00000100:00100000:3.0:1788916822.891998:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140692480 00000100:00100000:3.0:1788916822.892011:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140692480 00000100:00100000:3.0:1788916822.892064:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788916822.892085:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4332393 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:5789:x1875815140692480:12345-0@lo:501: 00000100:00100000:3.0:1788916822.894577:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4332393 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:5789:x1875815140692480:12345-0@lo:501: Request processed in 2483us (3477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916822.894598:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788916822.895771:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bf45385f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140692480:0@lo:501: 00000100:00100000:0.0:1788916822.895860:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bf45385f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140692608:0@lo:503: 00000100:00100000:0.0:1788916822.895956:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916822.896003:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ac07e7dd going to sleep for 11 seconds 00000100:00100000:3.0:1788916822.897234:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140692608 00000100:00100000:3.0:1788916822.897247:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140692608 00000100:00100000:3.0:1788916822.897317:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788916822.897327:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087afed8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+12:5789:x1875815140692608:12345-0@lo:503: 00000100:00100000:3.0:1788916822.898394:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087afed8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+12:5789:x1875815140692608:12345-0@lo:503: Request processed in 1065us (2435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916822.898414:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788916822.900593:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bf45385f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140692608:0@lo:503: 00000100:00100000:0.0:1788916822.901526:0:6344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bf45385f pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:6344:1875815140692736:0@lo:502: 00000100:00100000:0.0:1788916822.901624:0:6344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916822.901680:0:6344:0:(client.c:2702:ptlrpc_set_wait()) set 00000000edbef769 going to sleep for 11 seconds 00000100:00100000:1.0:1788916822.901847:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140692736 00000100:00100000:1.0:1788916822.901856:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140692736 00000100:00100000:1.0:1788916822.901925:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788916822.901934:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ba5ff64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:6344:x1875815140692736:12345-0@lo:502: 00000100:00100000:1.0:1788916822.902251:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ba5ff64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:6344:x1875815140692736:12345-0@lo:502: Request processed in 317us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916822.902262:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788916822.902537:0:6344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bf45385f pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:6344:1875815140692736:0@lo:502: 00000020:01000000:0.0:1788916822.902572:0:6344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788916822.902585:0:6344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788916822.902588:0:6344:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788916822.902597:0:6344:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6e171d2800 00000020:00000080:0.0:1788916822.902600:0:6344:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788916822.902652:0:6344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:6344:1875815140692864:0@lo:502: 00000100:00100000:0.0:1788916822.902690:0:6344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916822.902727:0:6344:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e1fd0f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788916822.903764:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140692864 00000100:00100000:1.0:1788916822.903774:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140692864 00000100:00100000:1.0:1788916822.903841:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788916822.903852:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+12:6344:x1875815140692864:12345-0@lo:502: 00000100:00100000:1.0:1788916822.904121:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+12:6344:x1875815140692864:12345-0@lo:502: Request processed in 269us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916822.904130:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788916822.904388:0:6344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:6344:1875815140692864:0@lo:502: 00000020:01000000:0.0:1788916822.904430:0:6344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788916822.904438:0:6344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788916822.904440:0:6344:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788916822.904445:0:6344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788916822.906067:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788916822.906114:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788916822.906129:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0168e800/0x51de7f756a83d4a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d4ab expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916822.906169:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e0168e800/0x51de7f756a83d4a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d4ab expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916823.850642:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916824.864112:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916825.901829:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916826.917193:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916827.171084:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140692992:0@lo:400: 00000100:00100000:1.0:1788916827.171312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916827.174407:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788916827.174468:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140693120:0@lo:400: 00000100:00100000:1.0:1788916827.174580:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916827.175312:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140692992 00000100:00100000:1.0:1788916827.175328:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140692992 00000100:00100000:1.0:1788916827.175411:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788916827.175423:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+12:3304:x1875815140692992:12345-0@lo:400: 00000100:00100000:1.0:1788916827.175509:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+12:3304:x1875815140692992:12345-0@lo:400: Request processed in 88us (4198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916827.175518:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788916827.175582:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140692992:0@lo:400: 00000100:00100000:3.0:1788916827.177128:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140693120 00000100:00100000:3.0:1788916827.177164:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140693120 00000100:00100000:3.0:1788916827.177466:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788916827.177479:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140693120:12345-0@lo:400: 00000100:00100000:3.0:1788916827.179420:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a771880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140693120:12345-0@lo:400: Request processed in 1933us (4828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916827.179437:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788916827.187674:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a6e28c2c000 x1875815140693120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916827.187698:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140693120:0@lo:400: 00010000:00010000:0.0:1788916827.935350:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788916828.008668:0:6587:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788916828.008673:0:6587:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788916828.008794:0:6587:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a6e2c984800 00000020:01000004:0.0:1788916828.008811:0:6587:0:(tgt_mount.c:2592:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788916828.008823:0:6587:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788916828.008843:0:6587:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a6e1fe919c0) 00000020:00000080:0.0:1788916828.008861:0:6587:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788916828.025569:0:6587:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788916828.026086:0:6587:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788916828.066437:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788916828.080617:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788916828.080658:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788916828.080736:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788916828.080765:0:6587:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788916828.081814:0:6587:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788916828.082550:0:6587:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788916828.082572:0:6587:0:(genops.c:1407:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x51de7f756a83d4b9 00000020:01000004:3.0:1788916828.082583:0:6587:0:(tgt_mount.c:2677:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788916828.082613:0:6587:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788916828.082616:0:6587:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788916828.082625:0:6587:0:(tgt_mount.c:1890:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788916828.082631:0:6587:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788916828.082648:0:6587:0:(genops.c:414:class_newdev()) Allocate new device OSS (ffff9a6e2cd0cd40) 00000020:00000080:3.0:1788916828.082663:0:6587:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788916828.084469:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788916828.084680:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788916828.084689:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788916828.108909:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788916828.109011:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788916828.113532:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788916828.113552:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788916828.115602:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788916828.115834:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788916828.115842:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788916828.125070:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788916828.125102:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788916828.170900:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788916828.171479:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788916828.171488:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788916828.173746:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788916828.173764:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788916828.175890:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788916828.175909:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788916828.179093:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788916828.179585:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788916828.179594:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788916828.183760:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788916828.183780:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788916828.248110:0:6587:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788916828.248614:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788916828.248699:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788916828.250994:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788916828.251009:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788916828.251804:0:6587:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788916828.251845:0:6587:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788916828.251853:0:6587:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788916828.297689:0:6587:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788916828.297740:0:6587:0:(tgt_mount.c:1493:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.140@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788916828.297745:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788916828.297747:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788916828.297748:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788916828.297750:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788916828.297751:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788916828.297753:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788916828.297754:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788916828.297756:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788916828.297757:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788916828.297758:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788916828.297759:0:6587:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788916828.297763:0:6587:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788916828.297766:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788916828.297767:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788916828.297768:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788916828.297769:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788916828.297770:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788916828.297771:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788916828.297772:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788916828.297776:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788916828.297777:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788916828.297778:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788916828.297778:0:6587:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788916828.297815:0:6587:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788916828.297910:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140693248:0@lo:253: 00000100:00100000:2.0:1788916828.298493:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.298645:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b183780 going to sleep for 11 seconds 00000100:00100000:0.0:1788916828.298811:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140693248 00000100:00100000:0.0:1788916828.298824:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140693248 00000100:00100000:0.0:1788916828.299035:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788916828.299048:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:6587:x1875815140693248:12345-0@lo:253: 20000000:01000000:0.0:1788916828.299098:0:5786:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788916828.299104:0:5786:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788916828.299111:0:5786:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788916828.299117:0:5786:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788916828.302588:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788916828.303110:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788916828.303129:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788916828.304130:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788916828.304268:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788916828.304312:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788916828.304538:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788916828.305584:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788916828.305615:0:5786:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.140@tcp 20000000:01000000:1.0:1788916828.305688:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:1.0:1788916828.305730:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788916828.305738:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788916828.305787:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788916828.305798:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:1.0:1788916828.305906:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788916828.306075:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788916828.306119:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788916828.306501:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788916828.308504:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788916828.308546:0:5786:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.140@tcp 20000000:01000000:1.0:1788916828.308549:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:1.0:1788916828.308587:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788916828.308595:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788916828.308697:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788916828.308707:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:1.0:1788916828.308751:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788916828.308760:0:5786:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788916828.308786:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788916828.308815:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788916828.308897:0:5786:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788916828.308902:0:5786:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788916828.308911:0:5786:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788916828.308912:0:5786:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788916828.308915:0:5786:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788916828.308939:0:5786:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788916828.308943:0:5786:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788916828.309094:0:5786:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788916828.309097:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788916828.310292:0:6603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788916828.310806:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788916828.310914:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788916828.311122:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1788916828.311468:0:5786:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788916828.311472:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788916828.313099:0:6604:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1788916828.313296:0:6604:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1788916828.313479:0:6604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788916828.314799:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1788916828.314942:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1788916828.315126:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1788916828.315499:0:5786:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788916828.315503:0:5786:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788916828.317745:0:6605:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788916828.317941:0:6605:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788916828.318534:0:6605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788916828.321381:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788916828.321465:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788916828.321589:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:3.0:1788916828.321632:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788916828.321663:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d4c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.321689:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83d3e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d3d9 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.321698:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d3fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d3f5 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.321706:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e00030000/0x51de7f756a83d46c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d465 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.321715:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d4c7 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.321776:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e00030000/0x51de7f756a83d46c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d465 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.321795:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e00030000/0x51de7f756a83d46c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d465 expref: 12 pid: 5786 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916828.321815:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c990a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5786:1875815140693376:0@lo:104: 00000100:00100000:3.0:1788916828.321934:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788916828.322012:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d3fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d3f5 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.322031:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d3fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d3f5 expref: 12 pid: 5784 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916828.322041:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5786:1875815140693504:0@lo:104: 00000100:00100000:3.0:1788916828.322073:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788916828.322106:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83d3e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d3d9 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.322115:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83d3e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d3d9 expref: 12 pid: 5786 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916828.322122:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c992680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5786:1875815140693632:0@lo:104: 00000100:00100000:3.0:1788916828.322188:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916828.322211:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e2cf27000 going to sleep for 11 seconds 00000100:00100000:1.0:1788916828.322243:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140693376 00000100:00100000:1.0:1788916828.322258:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140693376 00000100:00100000:1.0:1788916828.322324:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140693504 00000100:00100000:1.0:1788916828.322340:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140693504 00000100:00100000:1.0:1788916828.322354:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140693632 00000100:00100000:1.0:1788916828.322356:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140693632 00000100:00100000:1.0:1788916828.322370:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788916828.322382:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c993800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+5:5786:x1875815140693376:12345-0@lo:104: 00010000:00010000:1.0:1788916828.322400:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e0149e600/0x51de7f756a83d465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d46c expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.322474:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788916828.322480:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c993800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+5:5786:x1875815140693376:12345-0@lo:104: Request processed in 100us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916828.322488:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788916828.322509:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788916828.322515:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c993480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+4:5786:x1875815140693504:12345-0@lo:104: 00010000:00010000:1.0:1788916828.322524:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f600/0x51de7f756a83d3f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d3fc expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916828.322571:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c990a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5786:1875815140693376:0@lo:104: 00010000:00010000:1.0:1788916828.322573:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788916828.322582:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c993480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+4:5786:x1875815140693504:12345-0@lo:104: Request processed in 66us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916828.322588:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5786:1875815140693504:0@lo:104: 00000100:00100000:1.0:1788916828.322593:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788916828.322610:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788916828.322616:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c991500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+3:5786:x1875815140693632:12345-0@lo:104: 00010000:00010000:1.0:1788916828.322634:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f400/0x51de7f756a83d3d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d3e0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.322676:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788916828.322681:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c991500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+3:5786:x1875815140693632:12345-0@lo:104: Request processed in 66us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916828.322698:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788916828.322702:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c992680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5786:1875815140693632:0@lo:104: 00010000:00010000:1.0:1788916828.322724:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788916828.322733:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e0149e600/0x51de7f756a83d465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d46c expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.322739:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d4c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.322756:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0149e600 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1788916828.322762:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0149e600/0x51de7f756a83d465 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d46c expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.322773:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e0149e600/0x51de7f756a83d465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d46c expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788916828.322783:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0149e600/0x51de7f756a83d465 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d46c expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916828.322790:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788916828.322835:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e0149e600/0x51de7f756a83d465 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d46c expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.322843:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788916828.322872:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e0149e600/0x51de7f756a83d465 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d46c expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.322881:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e0149e600/0x51de7f756a83d465 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d46c expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.322908:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788916828.322912:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f600/0x51de7f756a83d3f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d3fc expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.322917:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f600 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1788916828.322920:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f600/0x51de7f756a83d3f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d3fc expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.322926:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f600/0x51de7f756a83d3f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d3fc expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788916828.322932:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f600/0x51de7f756a83d3f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d3fc expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916828.322937:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788916828.322963:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f600/0x51de7f756a83d3f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d3fc expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.322969:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788916828.322975:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f600/0x51de7f756a83d3f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d3fc expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.322982:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f600/0x51de7f756a83d3f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d3fc expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.322993:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788916828.322996:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f400/0x51de7f756a83d3d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d3e0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.323013:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0149f400 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1788916828.323015:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f400/0x51de7f756a83d3d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d3e0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.323034:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f400/0x51de7f756a83d3d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d3e0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788916828.323040:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f400/0x51de7f756a83d3d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d3e0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916828.323046:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788916828.323062:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f400/0x51de7f756a83d3d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d3e0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.323068:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788916828.323095:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f400/0x51de7f756a83d3d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d3e0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.323102:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f400/0x51de7f756a83d3d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d3e0 expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916828.323109:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a770a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140694016:0@lo:103: 00010000:00010000:1.0:1788916828.323125:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916828.323128:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916828.323131:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916828.323172:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916828.323177:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a773b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140693760:0@lo:103: 00000100:00100000:1.0:1788916828.323217:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788916828.323930:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916828.326831:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a772300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4933373a-b540-4420-bf34-9071e19d7373:3307:1875815140693888:0@lo:103: 00000100:00100000:0.0:1788916828.326945:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916828.327033:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140694016 00000100:00100000:1.0:1788916828.327044:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140694016 00010000:00010000:1.0:1788916828.327093:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83d3e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d3d9 expref: 13 pid: 5786 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916828.327112:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140693760 00000100:00100000:2.0:1788916828.327120:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140693760 00000100:00100000:3.0:1788916828.327129:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140693888 00000100:00100000:3.0:1788916828.327134:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140693888 00010000:00010000:2.0:1788916828.327229:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e00030000/0x51de7f756a83d46c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d465 expref: 15 pid: 5786 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916828.327254:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788916828.327265:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c992680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4933373a-b540-4420-bf34-9071e19d7373+15:3304:x1875815140694016:12345-0@lo:103: 00010000:00010000:1.0:1788916828.327282:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916828.327287:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83d3e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d3d9 expref: 15 pid: 5786 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.327299:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83d3e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d3d9 expref: 15 pid: 5786 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916828.327477:0:5779:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788916828.327487:0:5779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788916828.327682:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788916828.327693:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a773800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+15:3306:x1875815140693760:12345-0@lo:103: 00010000:00010000:2.0:1788916828.327703:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916828.327708:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e00030000/0x51de7f756a83d46c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d465 expref: 15 pid: 5786 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.327718:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e00030000/0x51de7f756a83d46c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d465 expref: 15 pid: 5786 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.327728:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e00030000/0x51de7f756a83d46c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d465 expref: 15 pid: 5786 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.327746:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788916828.327799:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83d3e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d3d9 expref: 15 pid: 5786 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916828.327801:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a773800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+14:3306:x1875815140693760:12345-0@lo:103: Request processed in 110us (4584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916828.327819:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788916828.327827:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916828.327878:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c992680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4933373a-b540-4420-bf34-9071e19d7373+12:3304:x1875815140694016:12345-0@lo:103: Request processed in 613us (4733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916828.327885:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788916828.327932:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a773b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140693760:0@lo:103: 00000100:00100000:2.0:1788916828.328080:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a770a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140694016:0@lo:103: 00010000:00010000:3.0:1788916828.328198:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d3fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d3f5 expref: 11 pid: 5784 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916828.328228:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788916828.328236:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+11:3307:x1875815140693888:12345-0@lo:103: 00010000:00010000:3.0:1788916828.328245:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916828.328250:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d3fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d3f5 expref: 11 pid: 5784 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.328267:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d3fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d3f5 expref: 11 pid: 5784 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.328277:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d3fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d3f5 expref: 11 pid: 5784 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.328292:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d4c7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.328302:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d4c7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.328318:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d4c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.328326:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d4c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.328334:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d4c7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.328342:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d4c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.328359:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0149e200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788916828.328364:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d4c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.328374:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d4c7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.328404:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d4c7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.328416:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916828.328461:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+10:3307:x1875815140693888:12345-0@lo:103: Request processed in 225us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916828.328468:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788916828.328485:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a772300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4933373a-b540-4420-bf34-9071e19d7373:3307:1875815140693888:0@lo:103: 00010000:00010000:1.0:1788916828.328488:0:5786:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d4c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.328500:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d4c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.328507:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d4c7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788916828.328525:0:5786:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788916828.373438:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+9:6587:x1875815140693248:12345-0@lo:253: Request processed in 74377us (74929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916828.373458:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788916828.373578:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140693248:0@lo:253: 10000000:01000000:2.0:1788916828.373598:0:6587:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788916828.373603:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788916828.373605:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788916828.373607:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788916828.373609:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788916828.373610:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788916828.373612:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788916828.373614:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788916828.373616:0:6587:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788916828.373684:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788916828.373685:0:6587:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788916828.373716:0:6587:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a6e2c984800 from lustre-OST0000 10000000:01000000:2.0:1788916828.373747:0:6587:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788916828.373751:0:6587:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788916828.373759:0:6587:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a6e0a73b380 local copy 10000000:01000000:2.0:1788916828.373765:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788916828.373816:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d4ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.373830:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d4ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.373842:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d4ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916828.373865:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140694144:0@lo:101: 00000100:00100000:2.0:1788916828.373912:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.374047:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b183180 going to sleep for 11 seconds 00000100:00100000:1.0:1788916828.374299:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140694144 00000100:00100000:1.0:1788916828.374405:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140694144 00000100:00100000:0.0:1788916828.374573:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788916828.374585:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+9:6587:x1875815140694144:12345-0@lo:101: 00010000:00010000:0.0:1788916828.374605:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916828.374636:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e00031200/0x51de7f756a83d4d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d4ce expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.374683:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00031200/0x51de7f756a83d4d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d4ce expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.374696:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e00031200/0x51de7f756a83d4d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d4ce expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.374709:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031200, rc 0) 00000100:00100000:0.0:1788916828.374765:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+10:6587:x1875815140694144:12345-0@lo:101: Request processed in 182us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916828.374772:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788916828.374850:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140694144:0@lo:101: 00010000:00010000:2.0:1788916828.374868:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d4ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x51de7f756a83d4d5 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.374885:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d4ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x51de7f756a83d4d5 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916828.375029:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140694272:0@lo:501: 00000100:00100000:2.0:1788916828.375061:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.375273:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b183180 going to sleep for 11 seconds 00000100:00100000:1.0:1788916828.375507:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140694272 00000100:00100000:1.0:1788916828.375514:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140694272 00000100:00100000:1.0:1788916828.375547:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788916828.375556:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+10:6587:x1875815140694272:12345-0@lo:501: 00000100:00100000:1.0:1788916828.375922:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+10:6587:x1875815140694272:12345-0@lo:501: Request processed in 367us (859us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788916828.375931:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788916828.376035:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140694272:0@lo:501: 10000000:01000000:2.0:1788916828.376051:0:6587:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788916828.376084:0:6587:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788916828.376092:0:6587:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d4ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x51de7f756a83d4d5 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.376102:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d4ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x51de7f756a83d4d5 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.376110:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d4ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x51de7f756a83d4d5 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.376168:0:6587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788916828.376192:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a6e2c984800 10000000:01000000:2.0:1788916828.376198:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788916828.376206:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a6e0a73b380 10000000:01000000:2.0:1788916828.376209:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788916828.376213:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9a6e0a73b380 from 1 10000000:01000000:2.0:1788916828.376216:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788916828.376247:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc800/0x51de7f756a83d4dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.376267:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc800/0x51de7f756a83d4dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.376278:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc800/0x51de7f756a83d4dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916828.376297:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140694400:0@lo:101: 00000100:00100000:2.0:1788916828.376329:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.376493:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b183cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1788916828.376556:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788916828.376565:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d4ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x51de7f756a83d4d5 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.376574:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fdc00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1788916828.376579:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d4ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x51de7f756a83d4d5 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.376589:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d4ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x51de7f756a83d4d5 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788916828.376598:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d4ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x51de7f756a83d4d5 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916828.376604:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788916828.376695:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d4ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x51de7f756a83d4d5 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.376703:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788916828.376754:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a773b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140694528:0@lo:103: 00000100:00100000:2.0:1788916828.376787:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916828.376854:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140694400 00000100:00100000:0.0:1788916828.376861:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140694400 00000100:00100000:0.0:1788916828.376896:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788916828.376905:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+10:6587:x1875815140694400:12345-0@lo:101: 00010000:00010000:0.0:1788916828.376917:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916828.376933:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e00030600/0x51de7f756a83d4e3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d4dc expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.376959:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00030600/0x51de7f756a83d4e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d4dc expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.376970:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e00030600/0x51de7f756a83d4e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d4dc expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.376979:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00030600, rc 0) 00000100:00100000:0.0:1788916828.377016:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+11:6587:x1875815140694400:12345-0@lo:101: Request processed in 113us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916828.377033:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1788916828.377113:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d4ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x51de7f756a83d4d5 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.377121:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d4ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x51de7f756a83d4d5 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.377185:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916828.377187:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916828.377189:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916828.377202:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140694528 00000100:00100000:1.0:1788916828.377205:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140694528 00000100:00100000:1.0:1788916828.377246:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788916828.377253:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4933373a-b540-4420-bf34-9071e19d7373+11:3305:x1875815140694528:12345-0@lo:103: 00010000:00010000:1.0:1788916828.377263:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916828.377277:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e00031200/0x51de7f756a83d4d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x51de7f756a83d4ce expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.377293:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916828.377604:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4933373a-b540-4420-bf34-9071e19d7373+10:3305:x1875815140694528:12345-0@lo:103: Request processed in 349us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916828.377612:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788916828.377740:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a773b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140694528:0@lo:103: 00000100:00100000:2.0:1788916828.377774:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140694400:0@lo:101: 00010000:00010000:2.0:1788916828.377791:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc800/0x51de7f756a83d4dc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d4e3 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.377802:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc800/0x51de7f756a83d4dc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d4e3 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788916828.377822:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788916828.377889:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc800/0x51de7f756a83d4dc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d4e3 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.377899:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc800/0x51de7f756a83d4dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d4e3 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788916828.377908:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788916828.377923:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788916828.377930:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788916828.377933:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788916828.377962:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fcc00/0x51de7f756a83d4ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.377970:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e013fcc00/0x51de7f756a83d4ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.377979:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e013fcc00/0x51de7f756a83d4ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916828.377995:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140694656:0@lo:101: 00000100:00100000:2.0:1788916828.378044:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.378082:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b183cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916828.378175:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140694656 00000100:00100000:0.0:1788916828.378182:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140694656 00000100:00100000:0.0:1788916828.378217:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788916828.378224:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+10:6587:x1875815140694656:12345-0@lo:101: 00010000:00010000:0.0:1788916828.378235:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916828.378248:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d4f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d4ea expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.378266:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d4ea expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.378274:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d4ea expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.378282:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00030e00, rc 0) 00000100:00100000:0.0:1788916828.378323:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+11:6587:x1875815140694656:12345-0@lo:101: Request processed in 100us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916828.378329:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788916828.378506:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140694656:0@lo:101: 00010000:00010000:2.0:1788916828.378518:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e013fcc00/0x51de7f756a83d4ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d4f1 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.378526:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e013fcc00/0x51de7f756a83d4ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d4f1 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916828.378652:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140694784:0@lo:501: 00000100:00100000:2.0:1788916828.378699:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.378719:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b183cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916828.378845:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140694784 00000100:00100000:0.0:1788916828.378849:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140694784 00000100:00100000:0.0:1788916828.378865:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788916828.378871:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+11:6587:x1875815140694784:12345-0@lo:501: 00000100:00100000:0.0:1788916828.379194:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+11:6587:x1875815140694784:12345-0@lo:501: Request processed in 322us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916828.379202:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788916828.379365:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140694784:0@lo:501: 00000100:00100000:2.0:1788916828.379399:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140694912:0@lo:503: 00000100:00100000:2.0:1788916828.379439:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.379476:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b183cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916828.379594:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140694912 00000100:00100000:0.0:1788916828.379599:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140694912 00000100:00100000:0.0:1788916828.379630:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788916828.379636:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+11:6587:x1875815140694912:12345-0@lo:503: 00000100:00100000:0.0:1788916828.379804:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+11:6587:x1875815140694912:12345-0@lo:503: Request processed in 167us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916828.379812:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788916828.380048:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140694912:0@lo:503: 00000040:00080000:2.0:1788916828.380581:0:6587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788916828.380681:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140695040:0@lo:502: 00000100:00100000:2.0:1788916828.380732:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.380772:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b183cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788916828.380885:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140695040 00000100:00100000:1.0:1788916828.380892:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140695040 00000100:00100000:1.0:1788916828.380935:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788916828.380943:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+11:6587:x1875815140695040:12345-0@lo:502: 00000100:00100000:1.0:1788916828.381124:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+11:6587:x1875815140695040:12345-0@lo:502: Request processed in 181us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916828.381132:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788916828.381311:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140695040:0@lo:502: 00000040:00080000:2.0:1788916828.381742:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788916828.381794:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788916828.381828:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788916828.381892:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788916828.381934:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788916828.381971:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788916828.382006:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140695168:0@lo:502: 00000100:00100000:2.0:1788916828.382064:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.382325:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b183cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788916828.382556:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140695168 00000100:00100000:1.0:1788916828.382563:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140695168 00000100:00100000:0.0:1788916828.382772:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788916828.382783:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+11:6587:x1875815140695168:12345-0@lo:502: 00000100:00100000:0.0:1788916828.382982:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+11:6587:x1875815140695168:12345-0@lo:502: Request processed in 200us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916828.382990:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788916828.383091:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140695168:0@lo:502: 00000040:00080000:2.0:1788916828.383222:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788916828.383234:0:6587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788916828.384414:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788916828.384429:0:6608:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788916828.384438:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788916828.384441:0:6608:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788916828.384451:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788916828.384471:0:6608:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0000 (ffff9a6e0b5c99c0) 00000020:00000080:2.0:1788916828.384504:0:6608:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788916828.384509:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788916828.384587:0:6608:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6e2c984800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788916828.384598:0:6608:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788916828.384706:0:6608:0:(genops.c:1407:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x51de7f756a83d4ff 00010000:00010000:2.0:1788916828.389750:0:6608:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788916828.390591:0:6608:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788916828.393747:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788916828.395014:0:6608:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788916828.401782:0:6608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788916828.403793:0:6608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788916828.405953:0:6608:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788916828.405969:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788916828.405978:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788916828.405981:0:6608:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788916828.405987:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788916828.405992:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788916828.405993:0:6608:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788916828.405996:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788916828.405998:0:6608:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788916828.406080:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788916828.406086:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788916828.406087:0:6608:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788916828.406091:0:6608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788916828.406349:0:6587:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788916828.406380:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788916828.406405:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fcc00/0x51de7f756a83d4ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d4f1 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.406420:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e013fcc00/0x51de7f756a83d4ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d4f1 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788916828.406430:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e2c984800 from 1 10000000:01000000:2.0:1788916828.406433:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788916828.406491:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc200/0x51de7f756a83d506 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.406502:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc200/0x51de7f756a83d506 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.406516:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc200/0x51de7f756a83d506 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916828.406545:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140695296:0@lo:101: 00000100:00100000:2.0:1788916828.406814:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.406885:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b183000 going to sleep for 11 seconds 00000100:00100000:1.0:1788916828.406959:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140695296 00000100:00100000:1.0:1788916828.406971:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140695296 00000100:00100000:1.0:1788916828.407041:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788916828.407053:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+11:6587:x1875815140695296:12345-0@lo:101: 00010000:00010000:1.0:1788916828.407087:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916828.407107:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e0168f600/0x51de7f756a83d50d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d506 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.407139:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0168f600/0x51de7f756a83d50d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d506 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.407183:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e0168f600/0x51de7f756a83d50d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d506 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916828.407191:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f600, rc 0) 00000100:00100000:1.0:1788916828.407244:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+12:6587:x1875815140695296:12345-0@lo:101: Request processed in 193us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916828.407253:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788916828.407591:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140695296:0@lo:101: 00010000:00010000:2.0:1788916828.407610:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc200/0x51de7f756a83d506 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d50d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.407633:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc200/0x51de7f756a83d506 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d50d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916828.407758:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140695424:0@lo:501: 00000100:00100000:2.0:1788916828.407793:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.407825:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b183000 going to sleep for 11 seconds 00000100:00100000:3.0:1788916828.407942:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140695424 00000100:00100000:3.0:1788916828.407948:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140695424 00000100:00100000:3.0:1788916828.407980:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788916828.407987:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:6587:x1875815140695424:12345-0@lo:501: 00000100:00100000:3.0:1788916828.408472:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:6587:x1875815140695424:12345-0@lo:501: Request processed in 483us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916828.408489:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788916828.408739:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140695424:0@lo:501: 00000100:00100000:2.0:1788916828.408781:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140695552:0@lo:503: 00000100:00100000:2.0:1788916828.408827:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.408864:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b183000 going to sleep for 11 seconds 00000100:00100000:1.0:1788916828.408917:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140695552 00000100:00100000:1.0:1788916828.408924:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140695552 00000100:00100000:1.0:1788916828.408960:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788916828.408969:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+12:6587:x1875815140695552:12345-0@lo:503: 00000100:00100000:1.0:1788916828.409283:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+12:6587:x1875815140695552:12345-0@lo:503: Request processed in 315us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916828.409291:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788916828.409528:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140695552:0@lo:503: 00000040:00080000:2.0:1788916828.409942:0:6587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788916828.410042:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140695680:0@lo:502: 00000100:00100000:2.0:1788916828.410098:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.410129:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b183000 going to sleep for 11 seconds 00000100:00100000:1.0:1788916828.410297:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140695680 00000100:00100000:1.0:1788916828.410304:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140695680 00000100:00100000:1.0:1788916828.410425:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788916828.410435:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+12:6587:x1875815140695680:12345-0@lo:502: 00000100:00100000:1.0:1788916828.410735:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+12:6587:x1875815140695680:12345-0@lo:502: Request processed in 301us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916828.410744:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788916828.410979:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140695680:0@lo:502: 00000040:00080000:2.0:1788916828.411316:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788916828.411574:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788916828.411612:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140695808:0@lo:502: 00000100:00100000:2.0:1788916828.411742:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.411824:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b183000 going to sleep for 11 seconds 00000100:00100000:1.0:1788916828.417587:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140695808 00000100:00100000:1.0:1788916828.417610:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140695808 00000100:00100000:1.0:1788916828.417763:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788916828.417776:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+12:6587:x1875815140695808:12345-0@lo:502: 00000100:00100000:1.0:1788916828.418125:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+12:6587:x1875815140695808:12345-0@lo:502: Request processed in 351us (6381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916828.418134:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788916828.418868:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140695808:0@lo:502: 00000040:00080000:2.0:1788916828.419126:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788916828.419176:0:6587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788916828.421012:0:6612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788916828.421038:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788916828.421041:0:6612:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788916828.421057:0:6612:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6e2c984800 00000020:00000080:2.0:1788916828.421059:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788916828.421086:0:6612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788916828.421090:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788916828.421091:0:6612:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788916828.421096:0:6612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788916828.421168:0:6587:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788916828.421190:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788916828.421210:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc200/0x51de7f756a83d506 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d50d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.421224:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc200/0x51de7f756a83d506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d50d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788916828.421263:0:6587:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788916828.421266:0:6587:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a6e2c984800 10000000:01000000:2.0:1788916828.421270:0:6587:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a6e2c984800 10000000:01000000:2.0:1788916828.421275:0:6587:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788916828.421283:0:6587:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a6e2c984800 from 1 10000000:01000000:2.0:1788916828.421285:0:6587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788916828.422700:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.422712:0:6587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.422724:0:6587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916828.422754:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140695936:0@lo:101: 00000100:00100000:2.0:1788916828.422842:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.422920:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b183180 going to sleep for 11 seconds 00000100:00100000:3.0:1788916828.425522:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140695936 00000100:00100000:3.0:1788916828.425546:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140695936 00000100:00100000:2.0:1788916828.425716:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788916828.425733:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+12:6587:x1875815140695936:12345-0@lo:101: 00010000:00010000:2.0:1788916828.425763:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916828.425790:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d51b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d514 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.425837:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d51b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d514 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.425850:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d51b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d514 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.425861:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e013fd800, rc 0) 00000100:00100000:2.0:1788916828.425960:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+13:6587:x1875815140695936:12345-0@lo:101: Request processed in 233us (3116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916828.425967:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788916828.426058:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140695936:0@lo:101: 00010000:00010000:2.0:1788916828.426083:0:6587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d514 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d51b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.426093:0:6587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d514 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d51b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916828.426293:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140696064:0@lo:501: 00000100:00100000:2.0:1788916828.426541:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.426583:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b183180 going to sleep for 11 seconds 00000100:00100000:3.0:1788916828.426676:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140696064 00000100:00100000:3.0:1788916828.426682:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140696064 00000100:00100000:3.0:1788916828.426719:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788916828.426727:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:6587:x1875815140696064:12345-0@lo:501: 00000100:00100000:3.0:1788916828.427060:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:6587:x1875815140696064:12345-0@lo:501: Request processed in 333us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916828.427067:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788916828.427354:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140696064:0@lo:501: 00000100:00100000:2.0:1788916828.427406:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140696192:0@lo:503: 00000100:00100000:2.0:1788916828.427454:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.427481:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b183180 going to sleep for 11 seconds 00000100:00100000:3.0:1788916828.427593:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140696192 00000100:00100000:3.0:1788916828.427600:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140696192 00000100:00100000:3.0:1788916828.427697:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788916828.427705:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:6587:x1875815140696192:12345-0@lo:503: 00000100:00100000:3.0:1788916828.428108:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:6587:x1875815140696192:12345-0@lo:503: Request processed in 403us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916828.428115:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788916828.429041:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140696192:0@lo:503: 00000040:00080000:2.0:1788916828.430435:0:6587:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788916828.430549:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140696320:0@lo:502: 00000100:00100000:2.0:1788916828.431475:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.431671:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b183180 going to sleep for 11 seconds 00000100:00100000:3.0:1788916828.434417:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140696320 00000100:00100000:3.0:1788916828.434435:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140696320 00000100:00100000:3.0:1788916828.434554:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788916828.434566:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0325c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+13:6587:x1875815140696320:12345-0@lo:502: 00000100:00100000:3.0:1788916828.434969:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0325c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+13:6587:x1875815140696320:12345-0@lo:502: Request processed in 404us (3496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916828.434979:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788916828.435133:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140696320:0@lo:502: 00000040:00080000:0.0:1788916828.435916:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788916828.435991:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788916828.436040:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788916828.436094:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788916828.436188:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788916828.436278:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788916828.436316:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788916828.436465:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788916828.436517:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788916828.436556:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788916828.436591:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788916828.436723:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788916828.436764:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788916828.436800:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788916828.436855:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788916828.436896:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788916828.436931:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788916828.436985:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788916828.437038:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788916828.437076:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788916828.437187:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788916828.437228:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788916828.437264:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788916828.437308:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788916828.437536:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788916828.437576:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788916828.437792:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788916828.437836:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788916828.437902:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140696448:0@lo:502: 00000100:00100000:0.0:1788916828.438009:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916828.438304:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e408fe300 going to sleep for 11 seconds 00000100:00100000:2.0:1788916828.438504:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140696448 00000100:00100000:2.0:1788916828.438514:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140696448 00000100:00100000:2.0:1788916828.438581:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788916828.438591:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0325e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+13:6587:x1875815140696448:12345-0@lo:502: 00000100:00100000:2.0:1788916828.438869:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0325e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+13:6587:x1875815140696448:12345-0@lo:502: Request processed in 277us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916828.438878:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788916828.438997:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140696448:0@lo:502: 00000040:00080000:0.0:1788916828.439098:0:6587:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788916828.439112:0:6587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788916828.439995:0:6613:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788916828.440015:0:6613:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a6e1fe94d40) 00000020:00000080:0.0:1788916828.440063:0:6613:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788916828.440311:0:6613:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6e2c984800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788916828.440317:0:6613:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6e2c984800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788916828.440320:0:6613:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6e2c984800 3 00010000:00080000:0.0:1788916828.440369:0:6613:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6e3f62b000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1788916828.441981:0:6613:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1788916828.442114:0:6613:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788916828.442188:0:6613:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788916828.442203:0:6613:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x51de7f756a83d529 00000100:00080000:0.0:1788916828.442216:0:6613:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788916828.442223:0:6613:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a6e3f62b000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1788916828.442275:0:6613:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e2d0b1f80 x1875815140696576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788916828.442328:0:6613:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788916828.445414:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875815140696576:0@lo:38: 00000100:00100000:2.0:1788916828.445516:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.445588:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788916828.445597:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140696704:0@lo:400: 00000100:00100000:2.0:1788916828.445796:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788916828.446710:0:6613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788916828.446769:0:6587:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788916828.446798:0:6587:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788916828.446816:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d514 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d51b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.446845:0:6587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d51b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788916828.446899:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788916828.446901:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788916828.446903:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788916828.446904:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788916828.446906:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788916828.446907:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788916828.446908:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788916828.446910:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788916828.446912:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788916828.446914:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788916828.446916:0:6587:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788916828.446920:0:6587:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788916828.446922:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788916828.446924:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788916828.446925:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788916828.446926:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788916828.446927:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788916828.446928:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788916828.446929:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788916828.446930:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788916828.446931:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788916828.446932:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788916828.446933:0:6587:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788916828.446960:0:6587:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788916828.446977:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140696832:0@lo:253: 00000100:00100000:2.0:1788916828.447057:0:6587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916828.447093:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e054f6300 going to sleep for 11 seconds 00000100:00100000:2.0:1788916828.447122:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140696832 00000100:00100000:2.0:1788916828.447131:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140696832 00000100:00100000:2.0:1788916828.447217:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788916828.447229:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0dd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+13:6587:x1875815140696832:12345-0@lo:253: 20000000:01000000:2.0:1788916828.447281:0:5786:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788916828.447302:0:5786:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788916828.451774:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140696576 00000100:00100000:1.0:1788916828.451796:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140696576 00000100:00100000:1.0:1788916828.451846:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140696704 00000100:00100000:1.0:1788916828.451849:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140696704 00000100:00100000:1.0:1788916828.451886:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788916828.451897:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140696704:12345-0@lo:400: 00000100:00100000:1.0:1788916828.452034:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140696704:12345-0@lo:400: Request processed in 138us (6237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916828.452043:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788916828.452065:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788916828.452069:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875815140696576:12345-0@lo:38: 00010000:00080000:1.0:1788916828.452100:0:5792:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:1.0:1788916828.452446:0:5792:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x51de7f756a83d530 00000004:00100000:1.0:1788916828.452466:0:5792:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788916828.452512:0:5792:0:(import.c:65:import_set_state_nolock()) ffff9a6e3f43a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788916828.452570:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875815140696576:12345-0@lo:38: Request processed in 499us (7055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916828.452578:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788916828.452827:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a6e28c2ed80 x1875815140696704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916828.452861:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140696704:0@lo:400: 00010000:00080000:1.0:1788916828.452913:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a6e2d0b1f80 x1875815140696576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788916838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916828.452922:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788916828.452931:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788916828.452940:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788916828.452945:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788916828.452948:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e3f62b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788916828.452954:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875815140696576:0@lo:38: 20000000:01000000:0.0:1788916828.489034:0:5786:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788916828.489094:0:5786:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788916828.492493:0:5808:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788916828.492506:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788916828.492542:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d537 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.492589:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e013fd000/0x51de7f756a83d496 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d48f expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.492599:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d537 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.493000:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e013fd000/0x51de7f756a83d496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d48f expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.493032:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e013fd000/0x51de7f756a83d496 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d48f expref: 13 pid: 5787 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916828.493055:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5808:1875815140696960:0@lo:104: 00000100:00100000:3.0:1788916828.493492:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916828.493576:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e2cf270c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788916828.493756:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140696960 00000100:00100000:2.0:1788916828.493768:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140696960 00000100:00100000:2.0:1788916828.493845:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788916828.493857:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c990a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+3:5808:x1875815140696960:12345-0@lo:104: 00010000:00010000:2.0:1788916828.493876:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e013fde00/0x51de7f756a83d48f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d496 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916828.493964:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788916828.493972:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c990a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+3:5808:x1875815140696960:12345-0@lo:104: Request processed in 117us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916828.493980:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788916828.494065:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788916828.494075:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e013fde00/0x51de7f756a83d48f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d496 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.494084:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fde00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:0.0:1788916828.494088:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e013fde00/0x51de7f756a83d48f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d496 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.494098:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e013fde00/0x51de7f756a83d48f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d496 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788916828.494107:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e013fde00/0x51de7f756a83d48f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d496 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788916828.494114:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788916828.494184:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e013fde00/0x51de7f756a83d48f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d496 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.494192:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788916828.494218:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e013fde00/0x51de7f756a83d48f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d496 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.494226:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e013fde00/0x51de7f756a83d48f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d496 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.494252:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916828.494253:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916828.494269:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916828.494307:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5808:1875815140696960:0@lo:104: 00010000:00010000:0.0:1788916828.494460:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d537 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916828.494803:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4933373a-b540-4420-bf34-9071e19d7373:3307:1875815140697088:0@lo:103: 00000100:00100000:1.0:1788916828.494858:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916828.494959:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140697088 00000100:00100000:0.0:1788916828.494964:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140697088 00010000:00010000:0.0:1788916828.494991:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e013fd000/0x51de7f756a83d496 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d48f expref: 14 pid: 5787 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916828.495034:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788916828.495042:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e08223850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+14:3307:x1875815140697088:12345-0@lo:103: 00010000:00010000:0.0:1788916828.495057:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788916828.495064:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e013fd000/0x51de7f756a83d496 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d48f expref: 14 pid: 5787 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.495075:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e013fd000/0x51de7f756a83d496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d48f expref: 14 pid: 5787 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.495093:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e013fd000/0x51de7f756a83d496 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d48f expref: 14 pid: 5787 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.495111:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d537 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.495122:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d537 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788916828.495420:0:5779:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002913386s 00010000:00010000:0.0:1788916828.495427:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d537 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.495456:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d537 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.495466:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d537 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.495473:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d537 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.495480:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0149f200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788916828.495486:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d537 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.495496:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d537 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.497748:0:5808:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d537 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916828.497780:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d537 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.497910:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d537 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.497926:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0149f200/0x51de7f756a83d537 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916828.497958:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788916828.498200:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e08223850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+13:3307:x1875815140697088:12345-0@lo:103: Request processed in 3154us (3336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916828.498214:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788916828.498502:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4933373a-b540-4420-bf34-9071e19d7373:3307:1875815140697088:0@lo:103: 00000100:00100000:1.0:1788916828.500671:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0dd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:6587:x1875815140696832:12345-0@lo:253: Request processed in 53432us (53601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916828.500690:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788916828.500875:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:6587:1875815140696832:0@lo:253: 10000000:01000000:3.0:1788916828.500898:0:6587:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788916828.500902:0:6587:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788916828.500903:0:6587:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788916828.500905:0:6587:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788916828.500906:0:6587:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788916828.500907:0:6587:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788916828.500931:0:6587:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788916828.500932:0:6587:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788916828.500934:0:6587:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788916828.500936:0:6587:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788916828.500938:0:6587:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788916828.500940:0:6587:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788916828.500978:0:6587:0:(tgt_mount.c:2781:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788916828.508070:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788916828.508536:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788916828.508841:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788916828.509057:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788916828.509557:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788916828.509898:0:6587:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788916828.511870:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788916828.846667:0:6587:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788916828.846675:0:6587:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788916828.846719:0:6587:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788916828.846797:0:6587:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788916828.846829:0:6587:0:(tgt_mount.c:2550:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788916828.846872:0:6587:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788916828.962053:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916829.993078:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916831.008294:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788916831.455259:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788916831.455269:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a6e171d2800 from 21 10000000:01000000:2.0:1788916831.455276:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788916831.455397:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fca00/0x51de7f756a83d53e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916831.455411:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e013fca00/0x51de7f756a83d53e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916831.455437:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e013fca00/0x51de7f756a83d53e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916831.455468:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140697216:0@lo:101: 00000100:00100000:2.0:1788916831.455557:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916831.455676:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e054fa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916831.466127:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140697216 00000100:00100000:0.0:1788916831.466164:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140697216 00000100:00100000:0.0:1788916831.466239:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788916831.466253:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+12:5789:x1875815140697216:12345-0@lo:101: 00010000:00010000:0.0:1788916831.466279:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916831.466316:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e00031200/0x51de7f756a83d545 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d53e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916831.466354:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00031200/0x51de7f756a83d545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d53e expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916831.466367:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e00031200/0x51de7f756a83d545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d53e expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916831.466379:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031200, rc 0) 00000100:00100000:0.0:1788916831.466477:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+13:5789:x1875815140697216:12345-0@lo:101: Request processed in 228us (10919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916831.466484:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788916831.466574:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140697216:0@lo:101: 00010000:00010000:0.0:1788916831.466594:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e013fca00/0x51de7f756a83d53e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d545 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916831.466605:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e013fca00/0x51de7f756a83d53e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d545 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916831.466682:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140697344:0@lo:501: 00000100:00100000:0.0:1788916831.466733:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916831.466764:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01effc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788916831.469330:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140697344 00000100:00100000:1.0:1788916831.469353:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140697344 00000100:00100000:1.0:1788916831.469423:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788916831.469435:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:5789:x1875815140697344:12345-0@lo:501: 00000100:00100000:1.0:1788916831.469811:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:5789:x1875815140697344:12345-0@lo:501: Request processed in 378us (3076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916831.469820:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788916831.469894:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140697344:0@lo:501: 00000100:00100000:1.0:1788916831.469973:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a771c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140697472:0@lo:503: 00000100:00100000:1.0:1788916831.470049:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916831.470084:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e28d65900 going to sleep for 11 seconds 00000100:00100000:1.0:1788916831.470097:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140697472 00000100:00100000:1.0:1788916831.470101:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140697472 00000100:00100000:1.0:1788916831.470127:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788916831.470133:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:5789:x1875815140697472:12345-0@lo:503: 00000100:00100000:1.0:1788916831.470331:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:5789:x1875815140697472:12345-0@lo:503: Request processed in 196us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916831.470337:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788916831.470383:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a771c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140697472:0@lo:503: 00000100:00100000:1.0:1788916831.470636:0:6710:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a771c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:6710:1875815140697600:0@lo:502: 00000100:00100000:1.0:1788916831.470677:0:6710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916831.470695:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140697600 00000100:00100000:1.0:1788916831.470700:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140697600 00000100:00100000:1.0:1788916831.470722:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788916831.470729:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:6710:x1875815140697600:12345-0@lo:502: 00000100:00100000:1.0:1788916831.470884:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:6710:x1875815140697600:12345-0@lo:502: Request processed in 155us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916831.470891:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788916831.470926:0:6710:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e28d65840 going to sleep for 11 seconds 00000100:00100000:1.0:1788916831.470939:0:6710:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a771c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:6710:1875815140697600:0@lo:502: 00000100:00100000:1.0:1788916831.470979:0:6710:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a771c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:6710:1875815140697728:0@lo:502: 00000100:00100000:1.0:1788916831.471026:0:6710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916831.471045:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140697728 00000100:00100000:1.0:1788916831.471054:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140697728 00000100:00100000:1.0:1788916831.471075:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788916831.471081:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:6710:x1875815140697728:12345-0@lo:502: 00000100:00100000:1.0:1788916831.471271:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:6710:x1875815140697728:12345-0@lo:502: Request processed in 190us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916831.471278:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788916831.471310:0:6710:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e28d65840 going to sleep for 11 seconds 00000100:00100000:1.0:1788916831.471322:0:6710:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a771c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:6710:1875815140697728:0@lo:502: 00000040:00080000:1.0:1788916831.471340:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788916831.471403:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788916831.471422:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788916831.471444:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fca00/0x51de7f756a83d53e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d545 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916831.471458:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e013fca00/0x51de7f756a83d53e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d545 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916831.471470:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788916831.471473:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a6e171d2800 from 4 10000000:01000000:1.0:1788916831.471476:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788916831.471510:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0168fc00/0x51de7f756a83d54c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916831.471519:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e0168fc00/0x51de7f756a83d54c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916831.471529:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e0168fc00/0x51de7f756a83d54c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916831.471541:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a771c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140697856:0@lo:101: 00000100:00100000:1.0:1788916831.471576:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916831.471591:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e28d65840 going to sleep for 11 seconds 00000100:00100000:1.0:1788916831.471602:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140697856 00000100:00100000:1.0:1788916831.471606:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140697856 00000100:00100000:1.0:1788916831.471628:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788916831.471634:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:5789:x1875815140697856:12345-0@lo:101: 00010000:00010000:1.0:1788916831.471643:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916831.471659:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e0168f800/0x51de7f756a83d553 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d54c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916831.471683:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0168f800/0x51de7f756a83d553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d54c expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916831.471694:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e0168f800/0x51de7f756a83d553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d54c expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916831.471704:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f800, rc 0) 00000100:00100000:1.0:1788916831.471731:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+14:5789:x1875815140697856:12345-0@lo:101: Request processed in 97us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916831.471736:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788916831.471766:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a771c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140697856:0@lo:101: 00010000:00010000:1.0:1788916831.471778:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e0168fc00/0x51de7f756a83d54c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d553 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916831.471787:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e0168fc00/0x51de7f756a83d54c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d553 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916831.471831:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a771c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140697984:0@lo:256: 00000100:00100000:1.0:1788916831.471870:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916831.471883:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e28d65840 going to sleep for 11 seconds 00000100:00100000:1.0:1788916831.471893:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140697984 00000100:00100000:1.0:1788916831.471897:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140697984 00000100:00100000:1.0:1788916831.471917:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788916831.471922:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+14:5789:x1875815140697984:12345-0@lo:256: 20000000:01000000:1.0:1788916831.471937:0:5784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788916831.471956:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788916831.471959:0:5784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788916831.472053:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+14:5789:x1875815140697984:12345-0@lo:256: Request processed in 130us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916831.472060:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788916831.472089:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a771c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140697984:0@lo:256: 10000000:01000000:1.0:1788916831.472133:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788916831.472139:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0168fc00/0x51de7f756a83d54c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d553 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916831.472186:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e0168fc00/0x51de7f756a83d54c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d553 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916831.472193:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788916831.472195:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788916831.472197:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788916831.472214:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f400/0x51de7f756a83d55a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916831.472220:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f400/0x51de7f756a83d55a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916831.472238:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f400/0x51de7f756a83d55a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916831.472250:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a771c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140698112:0@lo:101: 00000100:00100000:1.0:1788916831.472276:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916831.472295:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e28d65840 going to sleep for 11 seconds 00000100:00100000:1.0:1788916831.472306:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140698112 00000100:00100000:1.0:1788916831.472309:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140698112 00000100:00100000:1.0:1788916831.472332:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788916831.472339:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+14:5789:x1875815140698112:12345-0@lo:101: 00010000:00010000:1.0:1788916831.472346:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916831.472354:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d561 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d55a expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916831.472370:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d55a expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916831.472378:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d55a expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916831.472386:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168ec00, rc 0) 00000100:00100000:1.0:1788916831.472412:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+15:5789:x1875815140698112:12345-0@lo:101: Request processed in 74us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916831.472418:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788916831.472451:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a771c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140698112:0@lo:101: 00010000:00010000:1.0:1788916831.472461:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f400/0x51de7f756a83d55a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d561 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916831.472477:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f400/0x51de7f756a83d55a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d561 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916831.472519:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a771c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140698240:0@lo:501: 00000100:00100000:1.0:1788916831.472542:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916831.472554:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e28d65840 going to sleep for 11 seconds 00000100:00100000:1.0:1788916831.472563:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140698240 00000100:00100000:1.0:1788916831.472567:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140698240 00000100:00100000:1.0:1788916831.472585:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788916831.472592:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+15:5789:x1875815140698240:12345-0@lo:501: 00000100:00100000:1.0:1788916831.485522:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+15:5789:x1875815140698240:12345-0@lo:501: Request processed in 12914us (12963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916831.485540:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788916831.485713:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a771c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140698240:0@lo:501: 00000100:00100000:2.0:1788916831.485785:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140698368:0@lo:503: 00000100:00100000:2.0:1788916831.485857:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916831.485903:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e054fae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788916831.487170:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140698368 00000100:00100000:3.0:1788916831.487183:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140698368 00000100:00100000:3.0:1788916831.487246:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788916831.487257:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+15:5789:x1875815140698368:12345-0@lo:503: 00000100:00100000:3.0:1788916831.487618:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+15:5789:x1875815140698368:12345-0@lo:503: Request processed in 361us (1761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916831.487627:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788916831.487704:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140698368:0@lo:503: 00000100:00100000:3.0:1788916831.490443:0:6711:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c990380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:6711:1875815140698496:0@lo:502: 00000100:00100000:3.0:1788916831.490549:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916831.490606:0:6711:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e2cf27a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788916831.490953:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140698496 00000100:00100000:0.0:1788916831.490963:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140698496 00000100:00100000:0.0:1788916831.491107:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788916831.491120:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+15:6711:x1875815140698496:12345-0@lo:502: 00000100:00100000:0.0:1788916831.491512:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+15:6711:x1875815140698496:12345-0@lo:502: Request processed in 393us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916831.491521:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788916831.494619:0:6711:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c990380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:6711:1875815140698496:0@lo:502: 00000020:01000000:3.0:1788916831.494685:0:6711:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788916831.494694:0:6711:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788916831.494709:0:6711:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788916831.494711:0:6711:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788916831.494717:0:6711:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788916831.494721:0:6711:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:3.0:1788916831.494756:0:6711:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788916831.494759:0:6711:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788916831.494777:0:6711:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a6e2cd0b380) 00000020:00000080:3.0:1788916831.494805:0:6711:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788916831.494811:0:6711:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788916831.497261:0:6711:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788916831.497270:0:6711:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788916831.497282:0:6711:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x51de7f756a83d56f 00010000:00080000:3.0:1788916831.497330:0:6711:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6e0b4de000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1788916831.497588:0:6711:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788916831.627666:0:6711:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788916831.627700:0:6711:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788916831.628376:0:6711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788916831.628577:0:6711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788916831.628881:0:6711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788916831.628960:0:6711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788916831.630716:0:6719:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788916831.630725:0:6719:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788916831.632824:0:6711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788916831.632841:0:6711:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788916831.632885:0:6711:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788916831.632913:0:6711:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x51de7f756a83d576 00000100:00080000:3.0:1788916831.632928:0:6711:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788916831.632935:0:6711:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a6e0b4de000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1788916831.632999:0:6711:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e2c990380 x1875815140698624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788916831.633025:0:6711:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788916831.633080:0:6711:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788916831.633085:0:6711:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788916831.633087:0:6711:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788916831.633090:0:6711:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788916831.633094:0:6711:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788916831.633095:0:6711:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788916831.633097:0:6711:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788916831.633099:0:6711:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788916831.633131:0:6711:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c993100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:6711:1875815140698752:0@lo:502: 00000100:00100000:3.0:1788916831.633267:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916831.633332:0:6711:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e2cf27780 going to sleep for 11 seconds 00000100:00100000:3.0:1788916831.633360:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140698752 00000100:00100000:3.0:1788916831.633368:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140698752 00000100:00100000:3.0:1788916831.633414:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788916831.633431:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+15:6711:x1875815140698752:12345-0@lo:502: 00000100:00100000:3.0:1788916831.633718:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+15:6711:x1875815140698752:12345-0@lo:502: Request processed in 288us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916831.633727:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788916831.633795:0:6711:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c993100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:6711:1875815140698752:0@lo:502: 00000020:01000000:3.0:1788916831.633824:0:6711:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788916831.633828:0:6711:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788916831.633830:0:6711:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788916831.633834:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:2.0:1788916831.635700:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875815140699008:0@lo:400: 00000020:01000000:0.0:1788916831.635763:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00000100:00100000:2.0:1788916831.635766:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788916831.635793:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788916831.635807:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f400/0x51de7f756a83d55a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d561 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916831.636069:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788916831.636077:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140698880:0@lo:400: 00000100:00100000:2.0:1788916831.636104:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916831.636226:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140699008 00000100:00100000:2.0:1788916831.636235:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140699008 00000100:00100000:2.0:1788916831.636292:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140698880 00010000:00010000:0.0:1788916831.636300:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f400/0x51de7f756a83d55a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d561 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788916831.636314:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788916831.636317:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a6e0a73b380 from 1 10000000:01000000:0.0:1788916831.636320:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788916831.636353:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d57d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916831.636362:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d57d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916831.636373:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d57d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916831.636392:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140699136:0@lo:101: 00000100:00100000:0.0:1788916831.636436:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916831.636453:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01effc00 going to sleep for 11 seconds 00000100:00080000:0.0:1788916831.636475:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788916831.636487:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140699136 00000100:00100000:0.0:1788916831.636490:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140699136 00000100:00100000:0.0:1788916831.636517:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788916831.636525:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+15:5789:x1875815140699136:12345-0@lo:101: 00010000:00010000:0.0:1788916831.636540:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916831.636557:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83d584 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d57d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916831.636591:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140698880 00000100:00100000:2.0:1788916831.636614:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788916831.636620:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875815140699008:12345-0@lo:400: 00000100:00100000:2.0:1788916831.636670:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875815140699008:12345-0@lo:400: Request processed in 49us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916831.636678:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788916831.636693:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788916831.636699:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140698880:12345-0@lo:400: 00000100:00100000:2.0:1788916831.636737:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140698880:12345-0@lo:400: Request processed in 37us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916831.636743:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788916831.636760:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83d584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d57d expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916831.636775:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83d584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d57d expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788916831.636781:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e28c2ca80 x1875815140698880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788916831.636784:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031c00, rc 0) 00000100:00100000:0.0:1788916831.636815:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+16:5789:x1875815140699136:12345-0@lo:101: Request processed in 290us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916831.636866:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140698880:0@lo:400: 00010000:00080000:2.0:1788916831.636883:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e28c2f800 x1875815140699008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916831.636893:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875815140699008:0@lo:400: 00000100:00100000:0.0:1788916831.636909:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788916831.636947:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140699136:0@lo:101: 00010000:00010000:0.0:1788916831.636962:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d57d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d584 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916831.636971:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d57d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d584 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916831.637028:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140699264:0@lo:501: 00000100:00100000:0.0:1788916831.637063:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916831.637085:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01effc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788916831.637363:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140698624:0@lo:8: 00000100:00100000:1.0:1788916831.637403:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916831.638913:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140698624 00000100:00100000:3.0:1788916831.638926:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140698624 00000100:00100000:3.0:1788916831.638974:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788916831.639122:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a773480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875815140698624:12345-0@lo:8: 00010000:00080000:3.0:1788916831.639181:0:6590:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:3.0:1788916831.639217:0:6590:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x51de7f756a83d58b 00002000:00100000:3.0:1788916831.639258:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a6e0b4d8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211371a ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788916831.639262:0:6590:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788916831.639266:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788916831.639436:0:6590:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788916831.639608:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788916831.639641:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9a6e0b4de800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788916831.639742:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a773480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875815140698624:12345-0@lo:8: Request processed in 759us (2337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916831.639750:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788916831.640003:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140699264 00000100:00100000:2.0:1788916831.640011:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140699264 00000100:00100000:2.0:1788916831.640185:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788916831.640193:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+16:5789:x1875815140699264:12345-0@lo:501: 00000100:00100000:2.0:1788916831.640477:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+16:5789:x1875815140699264:12345-0@lo:501: Request processed in 284us (3413us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788916831.640484:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788916831.640506:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140699264:0@lo:501: 10000000:01000000:0.0:1788916831.640551:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788916831.640562:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d57d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d584 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916831.640575:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d57d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d584 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788916831.640750:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e2c990380 x1875815140698624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788916841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916831.640763:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788916831.640772:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788916831.640783:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788916831.640790:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788916831.640802:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e0b4de000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788916831.640950:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788916831.640958:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140698624:0@lo:8: 00000004:00080000:3.0:1788916831.640963:0:6719:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788916831.641109:0:6719:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 227672962150ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788916831.717246:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788916831.722007:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140699392:0@lo:13: 00000100:00100000:1.0:1788916831.722115:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916831.722251:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140699392 00000100:00100000:1.0:1788916831.722261:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140699392 00000100:00100000:1.0:1788916831.722336:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788916831.722349:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875815140699392:12345-0@lo:13: 00002000:00000024:1.0:1788916831.722408:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788916831.722465:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a772680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875815140699392:12345-0@lo:13: Request processed in 120us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916831.722474:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788916831.722503:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788916831.722561:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e2d0b3100 x1875815140699392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916831.722668:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140699392:0@lo:13: 00000004:00080000:0.0:1788916831.722849:0:6720:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788916831.722890:0:6720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6720:1875815140699520:0@lo:7: 00000100:00100000:0.0:1788916831.722928:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916831.722957:0:6720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e054c6540 going to sleep for 11 seconds 00000100:00100000:1.0:1788916831.723083:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140699520 00000100:00100000:1.0:1788916831.723090:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140699520 00000100:00100000:1.0:1788916831.723132:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788916831.723139:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6720:x1875815140699520:12345-0@lo:7: 00002000:00080000:0.0:1788916831.774514:0:6593:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788916831.774529:0:6593:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788916831.777110:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6720:x1875815140699520:12345-0@lo:7: Request processed in 53956us (54165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916831.777129:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788916831.777335:0:6720:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e2d0b0700 x1875815140699520/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788916847 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916831.777369:0:6720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6720:1875815140699520:0@lo:7: 00000004:00080000:3.0:1788916831.777390:0:6720:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788916831.777446:0:6720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c993100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6720:1875815140699648:0@lo:5: 00000100:00100000:3.0:1788916831.777497:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916831.778053:0:6720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e1ee00840 going to sleep for 11 seconds 00000100:00100000:3.0:1788916831.778082:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140699648 00000100:00100000:3.0:1788916831.778091:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140699648 00000100:00100000:3.0:1788916831.778685:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788916831.778701:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c992a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6720:x1875815140699648:12345-0@lo:5: 00002000:00080000:3.0:1788916831.778741:0:6592:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788916831.778745:0:6592:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788916831.781775:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c992a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6720:x1875815140699648:12345-0@lo:5: Request processed in 3066us (4265us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788916831.781791:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788916831.787275:0:6720:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e2c993100 x1875815140699648/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788916847 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916831.787313:0:6720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c993100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6720:1875815140699648:0@lo:5: 00000004:00080000:0.0:1788916831.787341:0:6720:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788916831.787406:0:6720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6720:1875815140699776:0@lo:700: 00000100:00100000:0.0:1788916831.787487:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916831.789913:0:6720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e054c6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788916831.800240:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140699776 00000100:00100000:1.0:1788916831.800258:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140699776 00000100:00100000:1.0:1788916831.800346:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788916831.800375:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6720:x1875815140699776:12345-0@lo:700: 00000100:00100000:1.0:1788916831.800456:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a771500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6600:1875815140699904:0@lo:700: 00000100:00100000:1.0:1788916831.800553:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916831.800596:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e28d65e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788916831.803061:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140699904 00000100:00100000:3.0:1788916831.803082:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140699904 00000100:00100000:3.0:1788916831.804052:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788916831.804071:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6600:x1875815140699904:12345-0@lo:700: 40000000:02000000:2.0:1788916831.866130:0:5799:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788916831.871326:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a770380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6600:x1875815140699904:12345-0@lo:700: Request processed in 67248us (70758us total) trans 0 rc 0/0 00010000:00080000:3.0:1788916831.871332:0:6600:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e0a771500 x1875815140699904/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788916847 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916831.871348:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788916831.871354:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a771500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6600:1875815140699904:0@lo:700: 40000000:02000000:3.0:1788916831.871372:0:6600:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:0.0:1788916832.036966:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916832.052974:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6720:x1875815140699776:12345-0@lo:700: Request processed in 252587us (265471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916832.053037:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788916832.053121:0:6720:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e2d0b0e00 x1875815140699776/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788916847 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916832.053181:0:6720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6720:1875815140699776:0@lo:700: 00000001:00080000:3.0:1788916832.053639:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788916832.053650:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:2.0:1788916832.164612:0:6720:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788916832.171768:0:6720:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a773100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6720:1875815140700032:0@lo:5: 00000100:00100000:1.0:1788916832.172709:0:6720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916832.172778:0:6720:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e058be3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916832.172926:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140700032 00000100:00100000:0.0:1788916832.172944:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140700032 00000100:00100000:0.0:1788916832.173091:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788916832.173102:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a772a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6720:x1875815140700032:12345-0@lo:5: 00002000:00080000:3.0:1788916832.225711:0:6593:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788916832.225748:0:6593:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788916832.240720:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a772a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6720:x1875815140700032:12345-0@lo:5: Request processed in 67610us (68006us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788916832.240736:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788916832.240931:0:6720:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e0a773100 x1875815140700032/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788916848 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916832.240951:0:6720:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788916832.240971:0:6720:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9a6e0a773100 x1875815140700032/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788916848 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916832.241005:0:6720:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a773100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6720:1875815140700032:0@lo:5: 00000004:00080000:1.0:1788916832.241026:0:6720:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788916833.055302:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916834.082047:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916835.103445:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916836.134068:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916836.895321:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788916836.895363:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140700160:0@lo:13: 00000100:00100000:1.0:1788916836.895469:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916836.895554:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140700160 00000100:00100000:1.0:1788916836.895565:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140700160 00000100:00100000:1.0:1788916836.895639:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788916836.895651:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875815140700160:12345-0@lo:13: 00002000:00000024:1.0:1788916836.895699:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916836.895753:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a771500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875815140700160:12345-0@lo:13: Request processed in 105us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916836.895777:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788916836.895805:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788916836.895844:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e0a771f80 x1875815140700160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916836.895867:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140700160:0@lo:13: 00000100:00100000:3.0:1788916836.899666:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140700416:0@lo:400: 00000100:00100000:3.0:1788916836.899759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916836.899812:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788916836.899819:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140700288:0@lo:400: 00000100:00100000:3.0:1788916836.899853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916836.899918:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140700416 00000100:00100000:3.0:1788916836.899928:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140700416 00000100:00100000:3.0:1788916836.900016:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788916836.900029:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140700416:12345-0@lo:400: 00000100:00100000:3.0:1788916836.900101:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140700416:12345-0@lo:400: Request processed in 74us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916836.900109:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788916836.900137:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140700288 00000100:00100000:3.0:1788916836.900141:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140700288 00000100:00100000:3.0:1788916836.900198:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788916836.900205:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+16:3305:x1875815140700288:12345-0@lo:400: 00000100:00100000:3.0:1788916836.900239:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+16:3305:x1875815140700288:12345-0@lo:400: Request processed in 34us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916836.900246:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788916836.900287:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788916836.900298:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140700544:0@lo:400: 00000100:00100000:3.0:1788916836.900326:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916836.900378:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140700288:0@lo:400: 00010000:00080000:3.0:1788916836.903284:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e2c990000 x1875815140700416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916836.903304:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140700416:0@lo:400: 00000100:00100000:1.0:1788916836.903707:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140700544 00000100:00100000:1.0:1788916836.903719:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140700544 00000100:00100000:1.0:1788916836.903811:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788916836.903826:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140700544:12345-0@lo:400: 00000100:00100000:1.0:1788916836.903970:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140700544:12345-0@lo:400: Request processed in 149us (3641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916836.903979:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788916836.904023:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e2c990700 x1875815140700544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916836.904034:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140700544:0@lo:400: 00000100:00080000:3.0:1788916836.904496:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788916837.151703:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788916837.518812:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1788916838.181219:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788916838.435838:0:6961:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788916839.201398:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916840.228599:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916841.250799:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916842.016593:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4933373a-b540-4420-bf34-9071e19d7373:3307:1875815140700672:0@lo:400: 00000100:00100000:1.0:1788916842.016702:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916842.016771:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788916842.016779:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a773b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140701056:0@lo:400: 00000100:00100000:1.0:1788916842.016808:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916842.016869:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a771c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140700800:0@lo:400: 00000100:00100000:1.0:1788916842.016928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916842.016949:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788916842.016954:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140700928:0@lo:400: 00000100:00100000:1.0:1788916842.016977:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916842.017009:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140700800 00000100:00100000:1.0:1788916842.017020:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140700800 00000100:00100000:1.0:1788916842.017079:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140700928 00000100:00100000:1.0:1788916842.017083:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140700928 00000100:00100000:1.0:1788916842.017114:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788916842.017124:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140700800:12345-0@lo:400: 00000100:00100000:1.0:1788916842.017235:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a770a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140700800:12345-0@lo:400: Request processed in 111us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916842.017243:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788916842.017265:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788916842.017271:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140700928:12345-0@lo:400: 00000100:00100000:1.0:1788916842.017299:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a771180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140700928:12345-0@lo:400: Request processed in 29us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916842.017305:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788916842.017353:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e0a773800 x1875815140700928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916842.017371:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a773800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140700928:0@lo:400: 00010000:00080000:1.0:1788916842.017383:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e0a771c00 x1875815140700800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916842.017391:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a771c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140700800:0@lo:400: 00000100:00100000:1.0:1788916842.017711:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788916842.017723:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140701184:0@lo:13: 00000100:00100000:1.0:1788916842.017764:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916842.017907:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140700672 00000100:00100000:3.0:1788916842.017913:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140700672 00000100:00100000:3.0:1788916842.017960:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788916842.017969:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+16:3307:x1875815140700672:12345-0@lo:400: 00000100:00100000:3.0:1788916842.018019:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+16:3307:x1875815140700672:12345-0@lo:400: Request processed in 52us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916842.018026:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1788916842.018062:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788916842.018232:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a771f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4933373a-b540-4420-bf34-9071e19d7373:3307:1875815140700672:0@lo:400: 00000100:00100000:3.0:1788916842.018284:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140701056 00000100:00100000:3.0:1788916842.018290:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140701056 00000100:00100000:3.0:1788916842.018331:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788916842.018339:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a772300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140701056:12345-0@lo:400: 00000100:00100000:3.0:1788916842.018383:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a772300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140701056:12345-0@lo:400: Request processed in 44us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916842.018389:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788916842.018408:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788916842.018426:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e0a773b80 x1875815140701056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916842.018436:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788916842.018448:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a773b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140701056:0@lo:400: 00000100:00100000:0.0:1788916842.018739:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140701184 00000100:00100000:0.0:1788916842.018745:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140701184 00000100:00100000:0.0:1788916842.018783:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788916842.018791:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a771c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140701184:12345-0@lo:13: 00002000:00000024:0.0:1788916842.018830:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788916842.018892:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a771c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140701184:12345-0@lo:13: Request processed in 101us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916842.018908:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788916842.019066:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e2d0b1880 x1875815140701184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916842.019084:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140701184:0@lo:13: 00010000:00010000:1.0:1788916842.275183:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916843.295494:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916844.320944:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916845.343716:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916846.369954:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916847.136997:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140701440:0@lo:400: 00000100:00100000:2.0:1788916847.137077:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140701696:0@lo:400: 00000100:00100000:2.0:1788916847.137204:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916847.137230:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140701312:0@lo:400: 00000100:00100000:2.0:1788916847.137277:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788916847.137285:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140701568:0@lo:400: 00000100:00100000:1.0:1788916847.137293:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916847.137320:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916847.137358:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140701312 00000100:00100000:2.0:1788916847.137366:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140701696 00000100:00100000:1.0:1788916847.137369:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140701312 00000100:00100000:2.0:1788916847.137372:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140701696 00000100:00100000:1.0:1788916847.137439:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788916847.137450:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788916847.137455:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+16:3304:x1875815140701312:12345-0@lo:400: 00000100:00100000:2.0:1788916847.137464:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140701696:12345-0@lo:400: 00000100:00100000:2.0:1788916847.137528:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140701696:12345-0@lo:400: Request processed in 67us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916847.137534:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+16:3304:x1875815140701312:12345-0@lo:400: Request processed in 83us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916847.137541:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788916847.137561:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788916847.137567:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788916847.137611:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e2c991c00 x1875815140701696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916847.137633:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140701696:0@lo:400: 00000100:00100000:2.0:1788916847.137675:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140701568 00000100:00100000:2.0:1788916847.137678:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140701568 00000100:00100000:2.0:1788916847.137707:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788916847.137713:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140701568:12345-0@lo:400: 00000100:00100000:0.0:1788916847.138400:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140701824:0@lo:13: 00000100:00080000:1.0:1788916847.138573:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788916847.140336:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140701568:12345-0@lo:400: Request processed in 2614us (3008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916847.140352:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788916847.140489:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e2c992680 x1875815140701568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916847.140506:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140701568:0@lo:400: 00000100:00100000:3.0:1788916847.144659:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916847.145000:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916847.145074:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140701312:0@lo:400: 00000100:00100000:1.0:1788916847.145410:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140701824 00000100:00100000:1.0:1788916847.145421:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140701824 00000100:00100000:1.0:1788916847.145493:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788916847.145506:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140701824:12345-0@lo:13: 00002000:00000024:1.0:1788916847.145588:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916847.145665:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140701824:12345-0@lo:13: Request processed in 162us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916847.145674:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788916847.146039:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e2d0b3b80 x1875815140701824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916847.146069:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140701824:0@lo:13: 00000100:00100000:2.0:1788916847.146914:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140701440 00000100:00100000:2.0:1788916847.146926:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140701440 00000100:00100000:2.0:1788916847.147000:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788916847.147010:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140701440:12345-0@lo:400: 00000100:00100000:2.0:1788916847.147098:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140701440:12345-0@lo:400: Request processed in 89us (2450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916847.147104:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788916847.148359:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e2c991f80 x1875815140701440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916847.148380:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140701440:0@lo:400: 00010000:00010000:1.0:1788916847.391434:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916848.419596:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916849.447113:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916850.463681:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916851.489794:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916852.263134:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140701952:0@lo:400: 00000100:00100000:3.0:1788916852.263259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916852.263326:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788916852.263332:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140702336:0@lo:400: 00000100:00100000:3.0:1788916852.263362:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916852.263411:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140702080:0@lo:400: 00000100:00100000:3.0:1788916852.263464:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916852.263487:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788916852.263492:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140702208:0@lo:400: 00000100:00100000:3.0:1788916852.263516:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916852.263552:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140701952 00000100:00100000:3.0:1788916852.263563:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140701952 00000100:00100000:3.0:1788916852.263636:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788916852.263649:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+16:3305:x1875815140701952:12345-0@lo:400: 00000100:00100000:3.0:1788916852.263719:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+16:3305:x1875815140701952:12345-0@lo:400: Request processed in 72us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916852.263728:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788916852.263768:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140702336 00000100:00100000:3.0:1788916852.263779:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140702336 00000100:00100000:3.0:1788916852.263836:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788916852.263845:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c990700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140702336:12345-0@lo:400: 00000100:00100000:3.0:1788916852.263882:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c990700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140702336:12345-0@lo:400: Request processed in 39us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916852.263889:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788916852.263911:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788916852.263948:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e2c991c00 x1875815140702336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916852.263966:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140702336:0@lo:400: 00000100:00100000:3.0:1788916852.263977:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140701952:0@lo:400: 00000100:00100000:2.0:1788916852.264298:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140702080 00000100:00100000:2.0:1788916852.264303:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140702080 00000100:00100000:2.0:1788916852.264335:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140702208 00000100:00100000:2.0:1788916852.264339:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140702208 00000100:00100000:2.0:1788916852.264364:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788916852.264372:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140702080:12345-0@lo:400: 00000100:00100000:2.0:1788916852.264434:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140702080:12345-0@lo:400: Request processed in 63us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916852.264441:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788916852.264455:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788916852.264462:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140702208:12345-0@lo:400: 00000100:00100000:2.0:1788916852.264490:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140702208:12345-0@lo:400: Request processed in 30us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916852.264497:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788916852.264519:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788916852.264538:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e2c992680 x1875815140702208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916852.264550:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c992680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140702208:0@lo:400: 00010000:00080000:2.0:1788916852.264562:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e2c990000 x1875815140702080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916852.264580:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140702080:0@lo:400: 00000100:00100000:3.0:1788916852.264848:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140702464:0@lo:13: 00000100:00100000:3.0:1788916852.264885:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916852.264968:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140702464 00000100:00100000:0.0:1788916852.264974:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140702464 00000100:00100000:0.0:1788916852.265013:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788916852.265021:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140702464:12345-0@lo:13: 00002000:00000024:0.0:1788916852.265061:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788916852.265109:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140702464:12345-0@lo:13: Request processed in 89us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916852.265123:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788916852.265182:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e2d0b0a80 x1875815140702464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916852.265198:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140702464:0@lo:13: 00000020:01000004:1.0:1788916852.354685:0:7487:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788916852.354689:0:7487:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788916852.354852:0:7487:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a6e3f439800 00000020:01000004:1.0:1788916852.354874:0:7487:0:(tgt_mount.c:2592:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788916852.354890:0:7487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788916852.354907:0:7487:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a6e0a77b380) 00000020:00000080:1.0:1788916852.354928:0:7487:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788916852.371727:0:7487:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788916852.372262:0:7487:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788916852.417245:0:7487:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788916852.424535:0:7487:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788916852.424569:0:7487:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788916852.424623:0:7487:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788916852.424645:0:7487:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788916852.425022:0:7487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788916852.425037:0:7487:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788916852.425049:0:7487:0:(genops.c:1407:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x51de7f756a83d599 00000020:01000004:1.0:1788916852.425059:0:7487:0:(tgt_mount.c:2677:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788916852.425089:0:7487:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788916852.425092:0:7487:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788916852.425098:0:7487:0:(tgt_mount.c:1890:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788916852.425125:0:7487:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788916852.425129:0:7487:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788916852.459294:0:7487:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788916852.459342:0:7487:0:(tgt_mount.c:1493:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.140@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788916852.459346:0:7487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788916852.459348:0:7487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788916852.459349:0:7487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788916852.459350:0:7487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788916852.459352:0:7487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788916852.459353:0:7487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788916852.459355:0:7487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788916852.459357:0:7487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788916852.459359:0:7487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788916852.459360:0:7487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788916852.459363:0:7487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788916852.459367:0:7487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788916852.459370:0:7487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788916852.459371:0:7487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788916852.459372:0:7487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788916852.459373:0:7487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788916852.459374:0:7487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788916852.459375:0:7487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788916852.459377:0:7487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788916852.459377:0:7487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788916852.459378:0:7487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788916852.459380:0:7487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788916852.459381:0:7487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788916852.459417:0:7487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788916852.459442:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140702592:0@lo:253: 00000100:00100000:0.0:1788916852.459552:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916852.459626:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e054f6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788916852.459932:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140702592 00000100:00100000:1.0:1788916852.459953:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140702592 00000100:00100000:1.0:1788916852.460041:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788916852.460053:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+16:7487:x1875815140702592:12345-0@lo:253: 20000000:01000000:1.0:1788916852.460100:0:5784:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788916852.460106:0:5784:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788916852.460113:0:5784:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788916852.460120:0:5784:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788916852.461302:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788916852.461542:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788916852.461559:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788916852.461602:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788916852.461611:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788916852.461642:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788916852.461691:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788916852.462106:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788916852.462133:0:5784:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.140@tcp 20000000:01000000:1.0:1788916852.462135:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:1.0:1788916852.462198:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788916852.462206:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788916852.462263:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788916852.462274:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:1.0:1788916852.462308:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788916852.462318:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788916852.462357:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788916852.462423:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788916852.465639:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788916852.465679:0:5784:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.202.140@tcp 20000000:01000000:1.0:1788916852.465682:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.140@tcp (null) (null) (null) 00000040:00080000:1.0:1788916852.465722:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788916852.465730:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788916852.465760:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788916852.465776:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.140@tcp (null) (null) 00000040:00080000:1.0:1788916852.465823:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788916852.465834:0:5784:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788916852.465896:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788916852.465941:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788916852.465961:0:5784:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788916852.465965:0:5784:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788916852.465974:0:5784:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788916852.465976:0:5784:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788916852.465978:0:5784:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788916852.465995:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788916852.465997:0:5784:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788916852.466036:0:5784:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788916852.466039:0:5784:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788916852.469832:0:7488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788916852.469978:0:7488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788916852.470017:0:7488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788916852.470686:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788916852.470735:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788916852.470822:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788916852.470837:0:5784:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788916852.470840:0:5784:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788916852.471905:0:7489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788916852.472284:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788916852.472333:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788916852.472412:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788916852.472428:0:5784:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788916852.472431:0:5784:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788916852.476981:0:7490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788916852.477122:0:7490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788916852.477385:0:7490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788916852.478087:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788916852.478363:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788916852.478563:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788916852.478580:0:5784:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788916852.478584:0:5784:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788916852.479324:0:7491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788916852.479619:0:7491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788916852.479684:0:7491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788916852.480016:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788916852.480058:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788916852.480124:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1788916852.480335:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788916852.480377:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.480410:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d4f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d4ea expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.480419:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d51b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d514 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.480427:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e00031200/0x51de7f756a83d545 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d53e expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.480434:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d561 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d55a expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.480449:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83d584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d57d expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.480457:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5a0 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.480507:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83d584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d57d expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.480523:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83d584 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d57d expref: 16 pid: 5787 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916852.480543:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1875815140702720:0@lo:104: 00000100:00100000:3.0:1788916852.480644:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788916852.480709:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d55a expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.480727:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d561 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d55a expref: 16 pid: 5784 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916852.480735:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1875815140702848:0@lo:104: 00010000:00010000:3.0:1788916852.480767:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e00031200/0x51de7f756a83d545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d53e expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.480775:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e00031200/0x51de7f756a83d545 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d53e expref: 16 pid: 5787 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916852.480782:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1875815140702976:0@lo:104: 00010000:00010000:3.0:1788916852.480816:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d51b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d514 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.480824:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d51b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d514 expref: 16 pid: 5787 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916852.480832:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1875815140703104:0@lo:104: 00010000:00010000:3.0:1788916852.480855:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d4ea expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.480862:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d4f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d4ea expref: 16 pid: 5784 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916852.480869:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1875815140703232:0@lo:104: 00000100:00100000:3.0:1788916852.480887:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e28dbf000 going to sleep for 11 seconds 00000100:00100000:2.0:1788916852.481032:0:5775:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788916852.481054:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916852.481084:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916852.481093:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916852.481102:0:5775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916852.481113:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140702720 00000100:00100000:2.0:1788916852.481121:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140702720 00000100:00100000:2.0:1788916852.481192:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140702848 00000100:00100000:2.0:1788916852.481195:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140702848 00000100:00100000:2.0:1788916852.481207:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140702976 00000100:00100000:2.0:1788916852.481210:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140702976 00000100:00100000:2.0:1788916852.481219:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140703104 00000100:00100000:2.0:1788916852.481221:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140703104 00000100:00100000:2.0:1788916852.481229:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140703232 00000100:00100000:2.0:1788916852.481231:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140703232 00000100:00100000:2.0:1788916852.481246:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788916852.481255:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ed48450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+7:5784:x1875815140702720:12345-0@lo:104: 00010000:00010000:2.0:1788916852.481271:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d57d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d584 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481354:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788916852.481362:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ed48450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+7:5784:x1875815140702720:12345-0@lo:104: Request processed in 108us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916852.481377:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788916852.481420:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788916852.481426:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+6:5784:x1875815140702848:12345-0@lo:104: 00010000:00010000:2.0:1788916852.481445:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f400/0x51de7f756a83d55a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d561 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481481:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788916852.481487:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+6:5784:x1875815140702848:12345-0@lo:104: Request processed in 61us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916852.481493:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788916852.481505:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788916852.481511:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+5:5784:x1875815140702976:12345-0@lo:104: 00010000:00010000:2.0:1788916852.481518:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e013fca00/0x51de7f756a83d53e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d545 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481546:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788916852.481550:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+5:5784:x1875815140702976:12345-0@lo:104: Request processed in 41us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916852.481556:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788916852.481567:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788916852.481575:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+4:5784:x1875815140703104:12345-0@lo:104: 00010000:00010000:2.0:1788916852.481582:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d51b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481607:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788916852.481611:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+4:5784:x1875815140703104:12345-0@lo:104: Request processed in 39us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916852.481625:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788916852.481638:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788916852.481644:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+3:5784:x1875815140703232:12345-0@lo:104: 00010000:00010000:2.0:1788916852.481651:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e013fcc00/0x51de7f756a83d4ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d4f1 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481680:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788916852.481685:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+3:5784:x1875815140703232:12345-0@lo:104: Request processed in 42us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916852.481691:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788916852.481711:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788916852.481719:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d57d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d584 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481727:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00030400 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1788916852.481731:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d57d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d584 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481740:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d57d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d584 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788916852.481748:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d57d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d584 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788916852.481754:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788916852.481791:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d57d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d584 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481809:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788916852.481840:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d57d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d584 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481846:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d57d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d584 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481860:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788916852.481863:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f400/0x51de7f756a83d55a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d561 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481868:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f400 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1788916852.481871:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f400/0x51de7f756a83d55a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d561 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481877:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f400/0x51de7f756a83d55a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d561 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788916852.481883:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f400/0x51de7f756a83d55a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d561 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788916852.481887:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788916852.481900:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f400/0x51de7f756a83d55a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d561 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481905:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788916852.481910:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f400/0x51de7f756a83d55a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d561 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481916:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f400/0x51de7f756a83d55a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d561 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481927:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788916852.481936:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e013fca00/0x51de7f756a83d53e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d545 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481941:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fca00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1788916852.481943:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e013fca00/0x51de7f756a83d53e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d545 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481949:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e013fca00/0x51de7f756a83d53e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d545 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788916852.481954:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e013fca00/0x51de7f756a83d53e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d545 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788916852.481959:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788916852.481971:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e013fca00/0x51de7f756a83d53e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d545 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481976:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788916852.481993:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e013fca00/0x51de7f756a83d53e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d545 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.481998:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e013fca00/0x51de7f756a83d53e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d545 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482007:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788916852.482011:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d51b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482015:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fdc00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1788916852.482018:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d51b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482033:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d51b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788916852.482040:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d51b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788916852.482046:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788916852.482060:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d514 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d51b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482065:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788916852.482071:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d514 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d51b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482077:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e013fdc00/0x51de7f756a83d514 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d51b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482088:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788916852.482091:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e013fcc00/0x51de7f756a83d4ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d4f1 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482097:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fcc00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1788916852.482100:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e013fcc00/0x51de7f756a83d4ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d4f1 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482107:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e013fcc00/0x51de7f756a83d4ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d4f1 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788916852.482113:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e013fcc00/0x51de7f756a83d4ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d4f1 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788916852.482125:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788916852.482138:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e013fcc00/0x51de7f756a83d4ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d4f1 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482166:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788916852.482171:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e013fcc00/0x51de7f756a83d4ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d4f1 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482177:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e013fcc00/0x51de7f756a83d4ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d4f1 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482193:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916852.482195:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916852.482197:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916852.482205:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916852.482231:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140703360:0@lo:103: 00000100:00100000:2.0:1788916852.482269:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916852.482295:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140703872:0@lo:103: 00000100:00100000:2.0:1788916852.482312:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916852.482334:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788916852.482339:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140703488:0@lo:103: 00000100:00100000:2.0:1788916852.482372:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916852.482405:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140703616:0@lo:103: 00000100:00100000:2.0:1788916852.482428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916852.482447:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788916852.482452:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140703744:0@lo:103: 00000100:00100000:2.0:1788916852.482471:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916852.482512:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140703360 00000100:00100000:2.0:1788916852.482518:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140703360 00010000:00010000:2.0:1788916852.482543:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83d584 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d57d expref: 17 pid: 5787 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916852.482560:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140703872 00000100:00100000:2.0:1788916852.482562:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140703872 00010000:00010000:2.0:1788916852.482588:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d4f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d4ea expref: 18 pid: 5784 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916852.482598:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140703488 00000100:00100000:2.0:1788916852.482601:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140703488 00010000:00010000:2.0:1788916852.482611:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d561 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d55a expref: 19 pid: 5784 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916852.482619:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140703616 00000100:00100000:2.0:1788916852.482621:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140703616 00010000:00010000:2.0:1788916852.482628:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e00031200/0x51de7f756a83d545 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d53e expref: 20 pid: 5787 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916852.482637:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140703744 00000100:00100000:2.0:1788916852.482639:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140703744 00010000:00010000:2.0:1788916852.482648:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d51b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d514 expref: 21 pid: 5787 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916852.482659:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788916852.482664:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+21:3306:x1875815140703360:12345-0@lo:103: 00010000:00010000:2.0:1788916852.482676:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916852.482681:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83d584 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d57d expref: 21 pid: 5787 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482692:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83d584 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d57d expref: 21 pid: 5787 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482720:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788916852.482750:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+21:3306:x1875815140703360:12345-0@lo:103: Request processed in 86us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916852.482756:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788916852.482771:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788916852.482778:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+20:3306:x1875815140703872:12345-0@lo:103: 00010000:00010000:2.0:1788916852.482786:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916852.482791:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d4f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d4ea expref: 20 pid: 5784 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482812:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d4f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d4ea expref: 20 pid: 5784 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482823:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788916852.482846:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+20:3306:x1875815140703872:12345-0@lo:103: Request processed in 68us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916852.482851:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788916852.482861:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788916852.482866:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3727a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+19:3306:x1875815140703488:12345-0@lo:103: 00010000:00010000:2.0:1788916852.482872:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916852.482875:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d561 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d55a expref: 19 pid: 5784 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482883:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d561 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d55a expref: 19 pid: 5784 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482891:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788916852.482910:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3727a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+19:3306:x1875815140703488:12345-0@lo:103: Request processed in 44us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916852.482925:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788916852.482937:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788916852.482943:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37279500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+18:3304:x1875815140703616:12345-0@lo:103: 00010000:00010000:2.0:1788916852.482950:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916852.482955:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e00031200/0x51de7f756a83d545 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d53e expref: 18 pid: 5787 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482962:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e00031200/0x51de7f756a83d545 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d53e expref: 18 pid: 5787 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.482971:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788916852.482998:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37279500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+18:3304:x1875815140703616:12345-0@lo:103: Request processed in 56us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916852.483004:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788916852.483014:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788916852.483020:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37278380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+17:3304:x1875815140703744:12345-0@lo:103: 00010000:00010000:2.0:1788916852.483026:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916852.483030:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d51b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d514 expref: 17 pid: 5787 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.483038:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d51b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d514 expref: 17 pid: 5787 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.483050:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.483059:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.483088:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.483096:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.483104:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.483111:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.483118:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0149f600 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788916852.483122:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.483129:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.483166:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.483178:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788916852.483202:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37278380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+17:3304:x1875815140703744:12345-0@lo:103: Request processed in 183us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916852.483208:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788916852.483253:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140703744:0@lo:103: 00000100:00100000:2.0:1788916852.483264:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140703616:0@lo:103: 00000100:00100000:2.0:1788916852.483289:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140703488:0@lo:103: 00000100:00100000:2.0:1788916852.483307:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140703360:0@lo:103: 00000100:00100000:2.0:1788916852.483313:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140703872:0@lo:103: 00010000:00010000:0.0:1788916852.483867:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83d584 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d57d expref: 16 pid: 5787 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916852.483885:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1875815140702720:0@lo:104: 00010000:00010000:0.0:1788916852.483896:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d561 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d55a expref: 15 pid: 5784 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916852.483905:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1875815140702848:0@lo:104: 00010000:00010000:0.0:1788916852.483914:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e00031200/0x51de7f756a83d545 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d53e expref: 14 pid: 5787 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916852.483922:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1875815140702976:0@lo:104: 00010000:00010000:0.0:1788916852.483932:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d51b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d514 expref: 13 pid: 5787 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916852.483942:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1875815140703104:0@lo:104: 00010000:00010000:0.0:1788916852.483951:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d4f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d4ea expref: 12 pid: 5784 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916852.483961:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5784:1875815140703232:0@lo:104: 00010000:00010000:0.0:1788916852.483986:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.483996:0:5784:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.484002:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.484018:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788916852.484036:0:5784:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1788916852.512236:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916852.586410:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+11:7487:x1875815140702592:12345-0@lo:253: Request processed in 126335us (126834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916852.586430:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788916852.586610:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140702592:0@lo:253: 10000000:01000000:0.0:1788916852.586632:0:7487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788916852.586636:0:7487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788916852.586639:0:7487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788916852.586640:0:7487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788916852.586642:0:7487:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788916852.586644:0:7487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788916852.586646:0:7487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788916852.586648:0:7487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788916852.586650:0:7487:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788916852.586652:0:7487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788916852.586653:0:7487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788916852.586680:0:7487:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a6e3f439800 from lustre-OST0001 10000000:01000000:0.0:1788916852.586709:0:7487:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788916852.586712:0:7487:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788916852.586722:0:7487:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a6e0a73b380 local copy 10000000:01000000:0.0:1788916852.586729:0:7487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788916852.586779:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83d5a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.586791:0:7487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83d5a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.586814:0:7487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83d5a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916852.586837:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140704000:0@lo:101: 00000100:00100000:0.0:1788916852.586899:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916852.587011:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e1ee009c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788916852.587919:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140704000 00000100:00100000:3.0:1788916852.587931:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140704000 00000100:00100000:3.0:1788916852.588127:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788916852.588139:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+11:7487:x1875815140704000:12345-0@lo:101: 00010000:00010000:3.0:1788916852.588184:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916852.588204:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e0149f800/0x51de7f756a83d5ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d5a7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.588237:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0149f800/0x51de7f756a83d5ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d5a7 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.588250:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e0149f800/0x51de7f756a83d5ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d5a7 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.588260:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0149f800, rc 0) 00000100:00100000:3.0:1788916852.588337:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+12:7487:x1875815140704000:12345-0@lo:101: Request processed in 200us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916852.588345:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788916852.588443:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140704000:0@lo:101: 00010000:00010000:0.0:1788916852.588463:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83d5a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x51de7f756a83d5ae expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.588474:0:7487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83d5a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x51de7f756a83d5ae expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916852.588619:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140704128:0@lo:501: 00000100:00100000:0.0:1788916852.588654:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916852.589073:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e1ee009c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788916852.589241:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140704128 00000100:00100000:2.0:1788916852.589248:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140704128 00000100:00100000:2.0:1788916852.589279:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788916852.589286:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:7487:x1875815140704128:12345-0@lo:501: 00000100:00100000:2.0:1788916852.589748:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:7487:x1875815140704128:12345-0@lo:501: Request processed in 460us (1092us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788916852.589758:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788916852.589877:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140704128:0@lo:501: 10000000:01000000:0.0:1788916852.589895:0:7487:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788916852.589930:0:7487:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788916852.589937:0:7487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83d5a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x51de7f756a83d5ae expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.589946:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83d5a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x51de7f756a83d5ae expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.589953:0:7487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83d5a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x51de7f756a83d5ae expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.589982:0:7487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788916852.590014:0:7487:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a6e3f439800 10000000:01000000:0.0:1788916852.590019:0:7487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788916852.590025:0:7487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788916852.590100:0:7487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788916852.590106:0:7487:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788916852.590109:0:7487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788916852.590141:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00031200/0x51de7f756a83d5b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.590173:0:7487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e00031200/0x51de7f756a83d5b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.590185:0:7487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e00031200/0x51de7f756a83d5b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916852.590203:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140704256:0@lo:101: 00000100:00100000:0.0:1788916852.590236:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916852.590261:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e1ee00180 going to sleep for 11 seconds 00000100:00100000:3.0:1788916852.590328:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140704256 00000100:00100000:3.0:1788916852.590334:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140704256 00000100:00100000:3.0:1788916852.590363:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788916852.590371:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+12:7487:x1875815140704256:12345-0@lo:101: 00010000:00010000:3.0:1788916852.590381:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916852.590472:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d5b5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.590502:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d5b5 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.590514:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d5b5 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.590536:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0149f600, rc 0) 00000100:00100000:3.0:1788916852.590570:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+13:7487:x1875815140704256:12345-0@lo:101: Request processed in 199us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916852.590576:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:2.0:1788916852.590651:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788916852.590660:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83d5a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x51de7f756a83d5ae expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.590669:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00030e00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1788916852.590673:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83d5a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x51de7f756a83d5ae expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.590684:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83d5a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x51de7f756a83d5ae expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788916852.590692:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83d5a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x51de7f756a83d5ae expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788916852.590697:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788916852.590721:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83d5a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x51de7f756a83d5ae expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.590737:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788916852.590771:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83d5a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x51de7f756a83d5ae expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.590779:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83d5a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x51de7f756a83d5ae expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.590804:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916852.590806:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916852.590807:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916852.590817:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788916852.590830:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3727b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140704384:0@lo:103: 00000100:00100000:2.0:1788916852.590862:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916852.590898:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140704384 00000100:00100000:2.0:1788916852.590902:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140704384 00000100:00100000:2.0:1788916852.590937:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788916852.590944:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3727aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+13:3306:x1875815140704384:12345-0@lo:103: 00010000:00010000:2.0:1788916852.590955:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916852.590971:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0149f800/0x51de7f756a83d5ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x51de7f756a83d5a7 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.590982:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788916852.591016:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3727aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+12:3306:x1875815140704384:12345-0@lo:103: Request processed in 73us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916852.591023:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788916852.591203:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140704256:0@lo:101: 00010000:00010000:0.0:1788916852.591219:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e00031200/0x51de7f756a83d5b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d5bc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.591228:0:7487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e00031200/0x51de7f756a83d5b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d5bc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916852.591326:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140704512:0@lo:501: 00000100:00100000:0.0:1788916852.591355:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916852.591383:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e1ee00180 going to sleep for 11 seconds 00000100:00100000:2.0:1788916852.591568:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3727b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140704384:0@lo:103: 00000100:00100000:2.0:1788916852.591586:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140704512 00000100:00100000:2.0:1788916852.591598:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140704512 00000100:00100000:2.0:1788916852.591619:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788916852.591624:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:7487:x1875815140704512:12345-0@lo:501: 00000100:00100000:2.0:1788916852.591879:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:7487:x1875815140704512:12345-0@lo:501: Request processed in 253us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916852.591887:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788916852.592007:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140704512:0@lo:501: 00000100:00100000:0.0:1788916852.592111:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140704640:0@lo:503: 00000100:00100000:0.0:1788916852.592181:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916852.592204:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e1ee00180 going to sleep for 11 seconds 00000100:00100000:1.0:1788916852.592283:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140704640 00000100:00100000:1.0:1788916852.592289:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140704640 00000100:00100000:1.0:1788916852.592506:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788916852.592515:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+12:7487:x1875815140704640:12345-0@lo:503: 00000100:00100000:1.0:1788916852.592695:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+12:7487:x1875815140704640:12345-0@lo:503: Request processed in 182us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916852.592703:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788916852.592784:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140704640:0@lo:503: 00000040:00080000:0.0:1788916852.593136:0:7487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788916852.593252:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140704768:0@lo:502: 00000100:00100000:0.0:1788916852.593296:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916852.593646:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e1ee00180 going to sleep for 11 seconds 00000100:00100000:3.0:1788916852.593697:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140704768 00000100:00100000:3.0:1788916852.593704:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140704768 00000100:00100000:3.0:1788916852.593742:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788916852.593749:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+12:7487:x1875815140704768:12345-0@lo:502: 00000100:00100000:3.0:1788916852.594092:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+12:7487:x1875815140704768:12345-0@lo:502: Request processed in 342us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916852.594101:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788916852.594338:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140704768:0@lo:502: 00000040:00080000:0.0:1788916852.594708:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788916852.594774:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788916852.594822:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788916852.594875:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788916852.594914:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788916852.594965:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788916852.595006:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140704896:0@lo:502: 00000100:00100000:0.0:1788916852.600122:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916852.600334:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140704896 00000100:00100000:2.0:1788916852.600348:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140704896 00000100:00100000:2.0:1788916852.600441:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788916852.600454:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:7487:x1875815140704896:12345-0@lo:502: 00000100:00100000:2.0:1788916852.600777:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:7487:x1875815140704896:12345-0@lo:502: Request processed in 325us (5630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916852.600787:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788916852.601595:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e1ee00180 going to sleep for 11 seconds 00000100:00100000:1.0:1788916852.601637:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140704896:0@lo:502: 00000040:00080000:1.0:1788916852.601880:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788916852.603269:0:7487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788916852.605679:0:7493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788916852.605694:0:7493:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788916852.605702:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788916852.605705:0:7493:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788916852.605711:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788916852.605732:0:7493:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0001 (ffff9a6e2cd08000) 00000020:00000080:3.0:1788916852.605763:0:7493:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788916852.605768:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788916852.605856:0:7493:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6e3f439800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788916852.605866:0:7493:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788916852.605874:0:7493:0:(genops.c:1407:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x51de7f756a83d5ca 00010000:00010000:3.0:1788916852.611359:0:7493:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788916852.611953:0:7493:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788916852.614698:0:7493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788916852.615102:0:7493:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788916852.618941:0:7493:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788916852.619704:0:7493:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788916852.633390:0:7493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788916852.633408:0:7493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788916852.633417:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788916852.633419:0:7493:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788916852.633423:0:7493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788916852.633427:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788916852.633428:0:7493:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788916852.633431:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788916852.633433:0:7493:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788916852.633515:0:7493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788916852.633519:0:7493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788916852.633520:0:7493:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788916852.633524:0:7493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788916852.633598:0:7487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788916852.633631:0:7487:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788916852.633660:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00031200/0x51de7f756a83d5b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d5bc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.633674:0:7487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e00031200/0x51de7f756a83d5b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d5bc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916852.633684:0:7487:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e3f439800 from 1 10000000:01000000:1.0:1788916852.633687:0:7487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788916852.633740:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0168ee00/0x51de7f756a83d5d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.633749:0:7487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e0168ee00/0x51de7f756a83d5d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.633788:0:7487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e0168ee00/0x51de7f756a83d5d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916852.633833:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a773800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140705024:0@lo:101: 00000100:00100000:1.0:1788916852.633930:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916852.633975:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06016c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788916852.634005:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140705024 00000100:00100000:1.0:1788916852.634013:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140705024 00000100:00100000:1.0:1788916852.634065:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788916852.634076:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+12:7487:x1875815140705024:12345-0@lo:101: 00010000:00010000:1.0:1788916852.634097:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916852.634113:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e0168f200/0x51de7f756a83d5d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d5d1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.634170:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0168f200/0x51de7f756a83d5d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d5d1 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.634183:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e0168f200/0x51de7f756a83d5d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d5d1 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.634194:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f200, rc 0) 00000100:00100000:1.0:1788916852.634241:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:7487:x1875815140705024:12345-0@lo:101: Request processed in 165us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916852.634249:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788916852.634311:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a773800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140705024:0@lo:101: 00010000:00010000:1.0:1788916852.634327:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e0168ee00/0x51de7f756a83d5d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d5d8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.634348:0:7487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e0168ee00/0x51de7f756a83d5d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d5d8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916852.634466:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a773800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140705152:0@lo:501: 00000100:00100000:1.0:1788916852.634493:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916852.634508:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06016c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788916852.639487:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140705152 00000100:00100000:2.0:1788916852.639508:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140705152 00000100:00100000:2.0:1788916852.639586:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788916852.639598:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+13:7487:x1875815140705152:12345-0@lo:501: 00000100:00100000:2.0:1788916852.640026:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+13:7487:x1875815140705152:12345-0@lo:501: Request processed in 430us (5530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916852.640035:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788916852.640502:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a773800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140705152:0@lo:501: 00000100:00100000:1.0:1788916852.640569:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a773800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140705280:0@lo:503: 00000100:00100000:1.0:1788916852.640625:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916852.640781:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06016c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788916852.643748:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140705280 00000100:00100000:2.0:1788916852.643763:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140705280 00000100:00100000:2.0:1788916852.643883:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788916852.643897:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b462050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+13:7487:x1875815140705280:12345-0@lo:503: 00000100:00100000:2.0:1788916852.644427:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b462050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+13:7487:x1875815140705280:12345-0@lo:503: Request processed in 531us (3799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916852.644444:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788916852.644591:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a773800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140705280:0@lo:503: 00000040:00080000:1.0:1788916852.644971:0:7487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788916852.645068:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a773800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140705408:0@lo:502: 00000100:00100000:1.0:1788916852.645124:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916852.645433:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06016c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788916852.645522:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140705408 00000100:00100000:0.0:1788916852.645530:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140705408 00000100:00100000:0.0:1788916852.645568:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788916852.645577:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+13:7487:x1875815140705408:12345-0@lo:502: 00000100:00100000:0.0:1788916852.645820:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+13:7487:x1875815140705408:12345-0@lo:502: Request processed in 243us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916852.645828:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788916852.645922:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a773800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140705408:0@lo:502: 00000040:00080000:1.0:1788916852.646234:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788916852.646289:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788916852.646320:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a773800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140705536:0@lo:502: 00000100:00100000:1.0:1788916852.646364:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916852.646386:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06016c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788916852.646450:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140705536 00000100:00100000:0.0:1788916852.646455:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140705536 00000100:00100000:0.0:1788916852.646479:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788916852.646486:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+13:7487:x1875815140705536:12345-0@lo:502: 00000100:00100000:0.0:1788916852.646626:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+13:7487:x1875815140705536:12345-0@lo:502: Request processed in 139us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916852.646640:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788916852.646706:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a773800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140705536:0@lo:502: 00000040:00080000:1.0:1788916852.646782:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788916852.646792:0:7487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788916852.647329:0:7497:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788916852.647341:0:7497:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788916852.647344:0:7497:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788916852.647350:0:7497:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6e3f439800 00000020:00000080:1.0:1788916852.647353:0:7497:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788916852.647373:0:7497:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788916852.647376:0:7497:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788916852.647377:0:7497:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788916852.647380:0:7497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788916852.647511:0:7487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788916852.647531:0:7487:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788916852.647555:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0168ee00/0x51de7f756a83d5d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d5d8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.647568:0:7487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e0168ee00/0x51de7f756a83d5d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d5d8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788916852.647614:0:7487:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788916852.647617:0:7487:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a6e3f439800 10000000:01000000:0.0:1788916852.647621:0:7487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a6e3f439800 10000000:01000000:0.0:1788916852.647625:0:7487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788916852.647631:0:7487:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a6e3f439800 from 1 10000000:01000000:0.0:1788916852.647634:0:7487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788916852.647670:0:7487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00031c00/0x51de7f756a83d5df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.647679:0:7487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e00031c00/0x51de7f756a83d5df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.647689:0:7487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e00031c00/0x51de7f756a83d5df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916852.647705:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140705664:0@lo:101: 00000100:00100000:0.0:1788916852.647751:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916852.647783:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e2d1d9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788916852.647811:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140705664 00000100:00100000:0.0:1788916852.647817:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140705664 00000100:00100000:0.0:1788916852.647854:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788916852.647861:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+13:7487:x1875815140705664:12345-0@lo:101: 00010000:00010000:0.0:1788916852.647874:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916852.647889:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d5e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d5df expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.647915:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d5e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d5df expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.647928:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d5e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d5df expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.647938:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00030e00, rc 0) 00000100:00100000:0.0:1788916852.647972:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+14:7487:x1875815140705664:12345-0@lo:101: Request processed in 111us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916852.647979:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788916852.648019:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140705664:0@lo:101: 00010000:00010000:0.0:1788916852.648034:0:7487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e00031c00/0x51de7f756a83d5df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d5e6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916852.648044:0:7487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e00031c00/0x51de7f756a83d5df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d5e6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916852.648139:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140705792:0@lo:501: 00000100:00100000:0.0:1788916852.648201:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916852.648219:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e2d1d9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788916852.648234:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140705792 00000100:00100000:0.0:1788916852.648237:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140705792 00000100:00100000:0.0:1788916852.648253:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788916852.648265:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+14:7487:x1875815140705792:12345-0@lo:501: 00000100:00100000:0.0:1788916852.648491:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+14:7487:x1875815140705792:12345-0@lo:501: Request processed in 226us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916852.648499:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788916852.648534:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140705792:0@lo:501: 00000100:00100000:0.0:1788916852.648561:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140705920:0@lo:503: 00000100:00100000:0.0:1788916852.648596:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916852.648609:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e2d1d9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788916852.648622:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140705920 00000100:00100000:0.0:1788916852.648625:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140705920 00000100:00100000:0.0:1788916852.648642:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788916852.648647:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+14:7487:x1875815140705920:12345-0@lo:503: 00000100:00100000:0.0:1788916852.648811:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+14:7487:x1875815140705920:12345-0@lo:503: Request processed in 149us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916852.648817:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788916852.648867:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140705920:0@lo:503: 00000040:00080000:0.0:1788916852.649196:0:7487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788916852.649256:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140706048:0@lo:502: 00000100:00100000:0.0:1788916852.649293:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916852.649315:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e054f6600 going to sleep for 11 seconds 00000100:00100000:0.0:1788916852.649331:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140706048 00000100:00100000:0.0:1788916852.649336:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140706048 00000100:00100000:0.0:1788916852.649355:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788916852.649360:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+14:7487:x1875815140706048:12345-0@lo:502: 00000100:00100000:0.0:1788916852.649530:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+14:7487:x1875815140706048:12345-0@lo:502: Request processed in 168us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916852.649546:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788916852.649590:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140706048:0@lo:502: 00000040:00080000:0.0:1788916852.649872:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788916852.649923:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788916852.649959:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788916852.650006:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788916852.650045:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788916852.650098:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788916852.650137:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788916852.650208:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788916852.650258:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788916852.650293:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788916852.650326:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788916852.650371:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788916852.650422:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788916852.650457:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788916852.650507:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788916852.650545:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788916852.650580:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788916852.650641:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788916852.650680:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788916852.650712:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788916852.650768:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788916852.651058:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788916852.651100:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788916852.651456:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788916852.651509:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788916852.651547:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788916852.651629:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788916852.651669:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788916852.651701:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788916852.651746:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788916852.651781:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788916852.651829:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788916852.651866:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788916852.651928:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788916852.651967:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788916852.652014:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788916852.652050:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788916852.652117:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a773800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140706176:0@lo:502: 00000100:00100000:1.0:1788916852.652423:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916852.652508:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e060163c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916852.652569:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140706176 00000100:00100000:0.0:1788916852.652578:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140706176 00000100:00100000:0.0:1788916852.652672:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788916852.652684:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+14:7487:x1875815140706176:12345-0@lo:502: 00000100:00100000:0.0:1788916852.652992:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+14:7487:x1875815140706176:12345-0@lo:502: Request processed in 310us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916852.653010:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788916852.653094:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a773800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140706176:0@lo:502: 00000040:00080000:1.0:1788916852.653208:0:7487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788916852.653221:0:7487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788916852.654094:0:7498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788916852.654114:0:7498:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a6e0b5ccd40) 00000020:00000080:2.0:1788916852.654141:0:7498:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788916852.658442:0:7498:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6e3f439800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788916852.658452:0:7498:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6e3f439800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788916852.658456:0:7498:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6e3f439800 3 00010000:00080000:2.0:1788916852.658520:0:7498:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6e3fe0f000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.140@tcp at head 00010000:00010000:2.0:1788916852.664937:0:7498:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788916852.665082:0:7498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788916852.665133:0:7498:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788916852.665194:0:7498:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x51de7f756a83d5f4 00000100:00080000:2.0:1788916852.665210:0:7498:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788916852.665218:0:7498:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a6e3fe0f000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1788916852.665280:0:7498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e3727b100 x1875815140706304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788916852.665308:0:7498:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788916852.666718:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3727b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875815140706304:0@lo:38: 00000100:00100000:1.0:1788916852.666837:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788916852.668740:0:7498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1788916852.668948:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140706304 00000100:00100000:3.0:1788916852.668961:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140706304 00000100:00100000:3.0:1788916852.669026:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788916852.669036:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875815140706304:12345-0@lo:38: 00010000:00080000:3.0:1788916852.669075:0:5792:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:3.0:1788916852.669116:0:5792:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x51de7f756a83d5fb 00000004:00100000:3.0:1788916852.669136:0:5792:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788916852.669204:0:5792:0:(import.c:65:import_set_state_nolock()) ffff9a6e2d1a5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788916852.669306:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a773800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875815140706304:12345-0@lo:38: Request processed in 271us (2468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916852.669313:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788916852.669365:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e3727b100 x1875815140706304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788916862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916852.669379:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788916852.669388:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788916852.669396:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788916852.669402:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788916852.669404:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e3fe0f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788916852.669411:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3727b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875815140706304:0@lo:38: 00000100:00100000:0.0:1788916852.670066:0:7500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7500:1875815140706432:0@lo:901: 00000100:00100000:0.0:1788916852.670121:0:7500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916852.670165:0:7500:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e0a7c86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788916852.670238:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140706432 00000100:00100000:3.0:1788916852.670244:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140706432 00000100:00100000:3.0:1788916852.670306:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788916852.670314:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7500:x1875815140706432:12345-0@lo:901: 00000100:00100000:3.0:1788916852.670761:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7500:x1875815140706432:12345-0@lo:901: Request processed in 446us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916852.670770:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788916852.670827:0:7500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e2d0b3800 x1875815140706432/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788916868 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916852.670853:0:7500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7500:1875815140706432:0@lo:901: 00000100:00080000:0.0:1788916852.671340:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:3.0:1788916852.671420:0:7487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788916852.671451:0:7487:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788916852.671478:0:7487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00031c00/0x51de7f756a83d5df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d5e6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916852.671490:0:7487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e00031c00/0x51de7f756a83d5df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d5e6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788916852.671545:0:7487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788916852.671548:0:7487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788916852.671550:0:7487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788916852.671551:0:7487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788916852.671552:0:7487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788916852.671554:0:7487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788916852.671556:0:7487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788916852.671557:0:7487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788916852.671559:0:7487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788916852.671561:0:7487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788916852.671563:0:7487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788916852.671568:0:7487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788916852.671569:0:7487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788916852.671571:0:7487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788916852.671571:0:7487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788916852.671572:0:7487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788916852.671574:0:7487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788916852.671574:0:7487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788916852.671575:0:7487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788916852.671576:0:7487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788916852.671577:0:7487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788916852.671578:0:7487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788916852.671579:0:7487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788916852.671603:0:7487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788916852.671616:0:7487:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140706560:0@lo:253: 00000100:00100000:3.0:1788916852.671675:0:7487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916852.671711:0:7487:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e0aaa9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788916852.671740:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140706560 00000100:00100000:3.0:1788916852.671746:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140706560 00000100:00100000:3.0:1788916852.671779:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788916852.671786:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+14:7487:x1875815140706560:12345-0@lo:253: 20000000:01000000:3.0:1788916852.671835:0:5784:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788916852.671853:0:5784:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788916852.703415:0:5784:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788916852.703438:0:5784:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788916852.703574:0:5808:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788916852.703581:0:5808:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788916852.703616:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d602 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.703647:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e0168f800/0x51de7f756a83d553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d54c expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.703657:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d602 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.703739:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e0168f800/0x51de7f756a83d553 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d54c expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.703757:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e0168f800/0x51de7f756a83d553 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d54c expref: 14 pid: 5784 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916852.703777:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37279f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5808:1875815140706688:0@lo:104: 00000100:00100000:2.0:1788916852.703880:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916852.703945:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e054c6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788916852.705359:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140706688 00000100:00100000:1.0:1788916852.705378:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140706688 00000100:00100000:1.0:1788916852.705461:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788916852.705473:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37278000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+3:5808:x1875815140706688:12345-0@lo:104: 00010000:00010000:1.0:1788916852.705499:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e0168fc00/0x51de7f756a83d54c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d553 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.705626:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788916852.705632:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37278000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+3:5808:x1875815140706688:12345-0@lo:104: Request processed in 162us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916852.705640:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788916852.705667:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788916852.705675:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e0168fc00/0x51de7f756a83d54c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d553 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.705683:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168fc00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1788916852.705688:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0168fc00/0x51de7f756a83d54c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d553 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.705697:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e0168fc00/0x51de7f756a83d54c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d553 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788916852.705705:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0168fc00/0x51de7f756a83d54c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d553 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916852.705712:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788916852.705765:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e0168fc00/0x51de7f756a83d54c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d553 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.705809:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788916852.705838:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e0168fc00/0x51de7f756a83d54c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d553 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.705844:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e0168fc00/0x51de7f756a83d54c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d553 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.705868:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916852.705870:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916852.705872:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916852.705899:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140706816:0@lo:103: 00000100:00100000:1.0:1788916852.705948:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916852.706005:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140706816 00000100:00100000:1.0:1788916852.706010:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140706816 00010000:00010000:1.0:1788916852.706031:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e0168f800/0x51de7f756a83d553 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d54c expref: 15 pid: 5784 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916852.706059:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788916852.706065:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e08221850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4933373a-b540-4420-bf34-9071e19d7373+15:3304:x1875815140706816:12345-0@lo:103: 00010000:00010000:1.0:1788916852.706079:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916852.706084:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e0168f800/0x51de7f756a83d553 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d54c expref: 15 pid: 5784 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.706095:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e0168f800/0x51de7f756a83d553 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d54c expref: 15 pid: 5784 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.706116:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d602 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.706135:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d602 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788916852.706222:0:6606:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002913386s 00010000:00010000:1.0:1788916852.706227:0:6606:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d602 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.706235:0:6606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d602 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.706242:0:6606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d602 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.706248:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d602 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.706254:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fcc00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788916852.706259:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d602 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.706268:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d602 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.706277:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d602 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916852.706289:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916852.706324:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e08221850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4933373a-b540-4420-bf34-9071e19d7373+15:3304:x1875815140706816:12345-0@lo:103: Request processed in 259us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916852.706331:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788916852.706445:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140706816:0@lo:103: 00010000:00010000:2.0:1788916852.706641:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0168f800/0x51de7f756a83d553 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d54c expref: 14 pid: 5784 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916852.706654:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37279f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5808:1875815140706688:0@lo:104: 00010000:00010000:2.0:1788916852.706670:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d602 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.706680:0:5808:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d602 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.706686:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d602 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916852.706693:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d602 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916852.712769:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:7487:x1875815140706560:12345-0@lo:253: Request processed in 40968us (41079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916852.712789:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788916852.712911:0:7487:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4933373a-b540-4420-bf34-9071e19d7373:7487:1875815140706560:0@lo:253: 10000000:01000000:3.0:1788916852.712932:0:7487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788916852.712936:0:7487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788916852.712937:0:7487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788916852.712939:0:7487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788916852.712940:0:7487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788916852.712941:0:7487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788916852.712943:0:7487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788916852.712945:0:7487:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788916852.712946:0:7487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788916852.712948:0:7487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788916852.712950:0:7487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788916852.712951:0:7487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788916852.712983:0:7487:0:(tgt_mount.c:2781:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788916852.718074:0:7487:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788916852.718260:0:7487:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788916852.718564:0:7487:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788916852.718708:0:7487:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788916852.718915:0:7487:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788916852.719312:0:7487:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788916852.720378:0:7487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788916852.961335:0:7487:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788916852.961345:0:7487:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788916852.961399:0:7487:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788916852.961474:0:7487:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788916852.961498:0:7487:0:(tgt_mount.c:2550:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788916852.961537:0:7487:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788916853.535716:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916854.565717:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916855.584836:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916856.608280:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916857.376054:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788916857.377065:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140706944:0@lo:13: 00000100:00100000:3.0:1788916857.377173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916857.377357:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140706944 00000100:00100000:0.0:1788916857.377368:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140706944 00000100:00100000:0.0:1788916857.377448:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788916857.377459:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140706944:12345-0@lo:13: 00002000:00000024:0.0:1788916857.377504:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788916857.377554:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140706944:12345-0@lo:13: Request processed in 96us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916857.377561:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788916857.377611:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788916857.377671:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e0a772d80 x1875815140706944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916857.377693:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140706944:0@lo:13: 00010000:00010000:3.0:1788916857.631485:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916857.896638:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140707328:0@lo:400: 00000100:00100000:1.0:1788916857.896725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916857.896805:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788916857.896812:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140707456:0@lo:400: 00000100:00100000:2.0:1788916857.896964:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140707072:0@lo:400: 00000100:00100000:2.0:1788916857.897015:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916857.897049:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788916857.897055:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140707200:0@lo:400: 00000100:00100000:2.0:1788916857.897080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916857.897118:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140707072 00000100:00100000:2.0:1788916857.897128:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140707072 00000100:00100000:2.0:1788916857.897211:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788916857.897222:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+13:3306:x1875815140707072:12345-0@lo:400: 00000100:00100000:2.0:1788916857.897287:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+13:3306:x1875815140707072:12345-0@lo:400: Request processed in 67us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916857.897295:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788916857.897338:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140707328 00000100:00100000:2.0:1788916857.897342:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140707328 00000100:00100000:2.0:1788916857.897391:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140707200 00000100:00100000:2.0:1788916857.897395:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140707200 00000100:00100000:2.0:1788916857.897407:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788916857.897413:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140707328:12345-0@lo:400: 00000100:00100000:2.0:1788916857.897448:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a773b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140707328:12345-0@lo:400: Request processed in 35us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916857.897454:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788916857.897465:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788916857.897470:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140707200:12345-0@lo:400: 00000100:00100000:2.0:1788916857.897496:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140707200:12345-0@lo:400: Request processed in 26us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916857.897501:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788916857.897521:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788916857.897557:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e0a770700 x1875815140707200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916857.897582:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a770700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140707200:0@lo:400: 00000100:00100000:2.0:1788916857.897594:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140707072:0@lo:400: 00000100:00100000:1.0:1788916857.897783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788916857.897812:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e0a770000 x1875815140707328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916857.897968:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140707328:0@lo:400: 00000100:00100000:1.0:1788916857.897998:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140707456 00000100:00100000:1.0:1788916857.898003:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140707456 00000100:00100000:1.0:1788916857.898046:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788916857.898052:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140707456:12345-0@lo:400: 00000100:00100000:1.0:1788916857.898092:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a773100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140707456:12345-0@lo:400: Request processed in 40us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916857.898097:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788916857.898115:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788916857.898133:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e0a772d80 x1875815140707456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916857.898141:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140707456:0@lo:400: 00010000:00010000:1.0:1788916858.656361:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916859.679381:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916860.703504:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788916860.991986:0:7843:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1788916861.472369:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788916861.472379:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a6e2c984800 from 30 10000000:01000000:1.0:1788916861.472387:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788916861.472458:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f800/0x51de7f756a83d609 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916861.472474:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f800/0x51de7f756a83d609 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916861.472489:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f800/0x51de7f756a83d609 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916861.472522:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a772d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140707584:0@lo:101: 00000100:00100000:1.0:1788916861.472619:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916861.472692:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06016d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788916861.477230:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140707584 00000100:00100000:3.0:1788916861.477254:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140707584 00000100:00100000:3.0:1788916861.478121:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788916861.478141:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:5789:x1875815140707584:12345-0@lo:101: 00010000:00010000:3.0:1788916861.478188:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916861.478218:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d610 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d609 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916861.478255:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d609 expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916861.478269:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d609 expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916861.478280:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0149e200, rc 0) 00000100:00100000:3.0:1788916861.478393:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+14:5789:x1875815140707584:12345-0@lo:101: Request processed in 261us (5773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916861.478401:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788916861.478486:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a772d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140707584:0@lo:101: 00010000:00010000:3.0:1788916861.478509:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f800/0x51de7f756a83d609 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d610 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916861.478521:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f800/0x51de7f756a83d609 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d610 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916861.478603:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140707712:0@lo:501: 00000100:00100000:3.0:1788916861.478642:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916861.478678:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cda600 going to sleep for 11 seconds 00000100:00100000:3.0:1788916861.478695:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140707712 00000100:00100000:3.0:1788916861.478701:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140707712 00000100:00100000:3.0:1788916861.478743:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788916861.478762:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+14:5789:x1875815140707712:12345-0@lo:501: 00000100:00100000:3.0:1788916861.479186:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+14:5789:x1875815140707712:12345-0@lo:501: Request processed in 424us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916861.479193:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788916861.479232:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140707712:0@lo:501: 00000100:00100000:3.0:1788916861.479266:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140707840:0@lo:503: 00000100:00100000:3.0:1788916861.479303:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916861.479317:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cda600 going to sleep for 11 seconds 00000100:00100000:3.0:1788916861.479329:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140707840 00000100:00100000:3.0:1788916861.479333:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140707840 00000100:00100000:3.0:1788916861.479357:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788916861.479363:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+14:5789:x1875815140707840:12345-0@lo:503: 00000100:00100000:3.0:1788916861.479642:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+14:5789:x1875815140707840:12345-0@lo:503: Request processed in 278us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916861.479650:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788916861.479693:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140707840:0@lo:503: 00000100:00100000:0.0:1788916861.482597:0:7864:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:7864:1875815140707968:0@lo:502: 00000100:00100000:0.0:1788916861.482726:0:7864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916861.482778:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140707968 00000100:00100000:0.0:1788916861.482786:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140707968 00000100:00100000:0.0:1788916861.482840:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788916861.482851:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+14:7864:x1875815140707968:12345-0@lo:502: 00000100:00100000:0.0:1788916861.483267:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+14:7864:x1875815140707968:12345-0@lo:502: Request processed in 417us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916861.483276:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788916861.483344:0:7864:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01effcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916861.483375:0:7864:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:7864:1875815140707968:0@lo:502: 00000100:00100000:0.0:1788916861.483436:0:7864:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:7864:1875815140708096:0@lo:502: 00000100:00100000:0.0:1788916861.483474:0:7864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916861.483504:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140708096 00000100:00100000:0.0:1788916861.483510:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140708096 00000100:00100000:0.0:1788916861.483533:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788916861.483540:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+14:7864:x1875815140708096:12345-0@lo:502: 00000100:00100000:0.0:1788916861.483670:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+14:7864:x1875815140708096:12345-0@lo:502: Request processed in 130us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916861.483676:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788916861.483703:0:7864:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01effcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916861.483726:0:7864:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:7864:1875815140708096:0@lo:502: 00000040:00080000:0.0:1788916861.483746:0:7864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788916861.483814:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788916861.483836:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788916861.483848:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f800/0x51de7f756a83d609 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d610 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.483873:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f800/0x51de7f756a83d609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d610 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788916861.483884:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788916861.483887:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788916861.483890:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788916861.483919:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83d617 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.483927:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83d617 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.483938:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83d617 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916861.483952:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140708224:0@lo:101: 00000100:00100000:0.0:1788916861.483983:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916861.483998:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01effcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916861.484013:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140708224 00000100:00100000:0.0:1788916861.484017:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140708224 00000100:00100000:0.0:1788916861.484040:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788916861.484046:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+14:5789:x1875815140708224:12345-0@lo:101: 00010000:00010000:0.0:1788916861.484057:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916861.484072:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e00031400/0x51de7f756a83d61e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d617 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.484097:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00031400/0x51de7f756a83d61e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d617 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.484124:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e00031400/0x51de7f756a83d61e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d617 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.484135:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031400, rc 0) 00000100:00100000:0.0:1788916861.484197:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+15:5789:x1875815140708224:12345-0@lo:101: Request processed in 150us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916861.484204:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788916861.484236:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140708224:0@lo:101: 00010000:00010000:0.0:1788916861.484250:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83d617 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d61e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.484260:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83d617 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d61e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916861.484303:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140708352:0@lo:501: 00000100:00100000:0.0:1788916861.484330:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916861.484344:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01effcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916861.484356:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140708352 00000100:00100000:0.0:1788916861.484360:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140708352 00000100:00100000:0.0:1788916861.484379:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788916861.484385:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+15:5789:x1875815140708352:12345-0@lo:501: 00000100:00100000:0.0:1788916861.484652:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+15:5789:x1875815140708352:12345-0@lo:501: Request processed in 266us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916861.484660:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788916861.484691:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140708352:0@lo:501: 00000100:00100000:0.0:1788916861.489013:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140708480:0@lo:503: 00000100:00100000:0.0:1788916861.489213:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916861.489269:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01effcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788916861.489439:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140708480 00000100:00100000:1.0:1788916861.489450:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140708480 00000100:00100000:1.0:1788916861.489503:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788916861.489514:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+15:5789:x1875815140708480:12345-0@lo:503: 00000100:00100000:1.0:1788916861.489971:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+15:5789:x1875815140708480:12345-0@lo:503: Request processed in 457us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916861.489979:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788916861.490076:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140708480:0@lo:503: 00000100:00100000:1.0:1788916861.490681:0:7866:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:7866:1875815140708608:0@lo:502: 00000100:00100000:1.0:1788916861.490753:0:7866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916861.490787:0:7866:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06016240 going to sleep for 11 seconds 00000100:00100000:0.0:1788916861.490983:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140708608 00000100:00100000:0.0:1788916861.490990:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140708608 00000100:00100000:0.0:1788916861.491127:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788916861.491139:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+15:7866:x1875815140708608:12345-0@lo:502: 00000100:00100000:0.0:1788916861.491455:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+15:7866:x1875815140708608:12345-0@lo:502: Request processed in 318us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916861.491464:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788916861.493505:0:7866:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:7866:1875815140708608:0@lo:502: 00000020:01000000:1.0:1788916861.493569:0:7866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788916861.493582:0:7866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788916861.493584:0:7866:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788916861.493593:0:7866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788916861.493595:0:7866:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788916861.493643:0:7866:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:7866:1875815140708736:0@lo:502: 00000100:00100000:1.0:1788916861.493740:0:7866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916861.494803:0:7866:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06016240 going to sleep for 11 seconds 00000100:00100000:0.0:1788916861.494941:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140708736 00000100:00100000:0.0:1788916861.494952:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140708736 00000100:00100000:0.0:1788916861.495111:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788916861.495123:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+15:7866:x1875815140708736:12345-0@lo:502: 00000100:00100000:0.0:1788916861.495685:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+15:7866:x1875815140708736:12345-0@lo:502: Request processed in 562us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916861.495695:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788916861.495815:0:7866:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:7866:1875815140708736:0@lo:502: 00000020:01000000:1.0:1788916861.495861:0:7866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788916861.495871:0:7866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788916861.495874:0:7866:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788916861.495881:0:7866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1788916861.496108:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788916861.496131:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788916861.496176:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83d617 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d61e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.496192:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83d617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d61e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788916861.496205:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788916861.496208:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a6e171d2800 from 30 10000000:01000000:0.0:1788916861.496212:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788916861.496258:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83d625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.496277:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83d625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.496290:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83d625 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916861.496434:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140708864:0@lo:101: 00000100:00100000:0.0:1788916861.496484:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916861.496970:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01effcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788916861.499695:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140708864 00000100:00100000:1.0:1788916861.499727:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140708864 00000100:00100000:1.0:1788916861.499823:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788916861.499839:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+15:5789:x1875815140708864:12345-0@lo:101: 00010000:00010000:1.0:1788916861.499869:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916861.499896:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e0168fc00/0x51de7f756a83d62c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d625 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916861.499933:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0168fc00/0x51de7f756a83d62c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d625 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916861.499948:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e0168fc00/0x51de7f756a83d62c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d625 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916861.499961:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168fc00, rc 0) 00000100:00100000:1.0:1788916861.500096:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+16:5789:x1875815140708864:12345-0@lo:101: Request processed in 262us (3611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916861.500105:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788916861.501582:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140708864:0@lo:101: 00010000:00010000:0.0:1788916861.501621:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83d625 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d62c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.501638:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83d625 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d62c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916861.501760:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140708992:0@lo:501: 00000100:00100000:0.0:1788916861.501832:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916861.501871:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01effcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916861.501900:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140708992 00000100:00100000:0.0:1788916861.501907:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140708992 00000100:00100000:0.0:1788916861.501944:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788916861.501953:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+16:5789:x1875815140708992:12345-0@lo:501: 00000100:00100000:0.0:1788916861.503848:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+16:5789:x1875815140708992:12345-0@lo:501: Request processed in 1887us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916861.503862:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788916861.505309:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140708992:0@lo:501: 00000100:00100000:0.0:1788916861.507681:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140709120:0@lo:503: 00000100:00100000:0.0:1788916861.507798:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916861.507854:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01eff900 going to sleep for 11 seconds 00000100:00100000:2.0:1788916861.507918:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140709120 00000100:00100000:2.0:1788916861.507929:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140709120 00000100:00100000:2.0:1788916861.508004:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788916861.508017:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+16:5789:x1875815140709120:12345-0@lo:503: 00000100:00100000:2.0:1788916861.508310:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+16:5789:x1875815140709120:12345-0@lo:503: Request processed in 294us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916861.508518:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140709120:0@lo:503: 00000100:00100000:2.0:1788916861.508601:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788916861.509458:0:7868:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:7868:1875815140709248:0@lo:502: 00000100:00100000:0.0:1788916861.509525:0:7868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916861.509571:0:7868:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01eff780 going to sleep for 11 seconds 00000100:00100000:1.0:1788916861.509639:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140709248 00000100:00100000:1.0:1788916861.509645:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140709248 00000100:00100000:1.0:1788916861.509692:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788916861.509701:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+16:7868:x1875815140709248:12345-0@lo:502: 00000100:00100000:1.0:1788916861.509953:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+16:7868:x1875815140709248:12345-0@lo:502: Request processed in 252us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916861.509962:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788916861.510189:0:7868:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:7868:1875815140709248:0@lo:502: 00000100:00100000:0.0:1788916861.510244:0:7868:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:7868:1875815140709376:0@lo:502: 00000100:00100000:0.0:1788916861.510277:0:7868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916861.510303:0:7868:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01eff780 going to sleep for 11 seconds 00000100:00100000:2.0:1788916861.510427:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140709376 00000100:00100000:2.0:1788916861.510432:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140709376 00000100:00100000:2.0:1788916861.510462:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788916861.510470:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+16:7868:x1875815140709376:12345-0@lo:502: 00000100:00100000:2.0:1788916861.510663:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+16:7868:x1875815140709376:12345-0@lo:502: Request processed in 193us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916861.510670:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788916861.512559:0:7868:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:7868:1875815140709376:0@lo:502: 00000040:00080000:0.0:1788916861.512613:0:7868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788916861.515431:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788916861.515471:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788916861.515487:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83d625 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d62c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916861.515502:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83d625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d62c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788916861.515604:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788916861.515609:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a6e171d2800 from 5 10000000:01000000:0.0:1788916861.515613:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788916861.515681:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d633 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.515691:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d633 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.515705:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d633 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916861.515747:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140709504:0@lo:101: 00000100:00100000:0.0:1788916861.515844:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916861.515902:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01eff780 going to sleep for 11 seconds 00000100:00100000:1.0:1788916861.515961:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140709504 00000100:00100000:1.0:1788916861.515971:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140709504 00000100:00100000:0.0:1788916861.516125:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788916861.516454:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+16:5789:x1875815140709504:12345-0@lo:101: 00010000:00010000:0.0:1788916861.516473:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916861.516509:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee3800/0x51de7f756a83d63a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d633 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.516542:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee3800/0x51de7f756a83d63a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d633 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.516553:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee3800/0x51de7f756a83d63a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d633 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.516564:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3800, rc 0) 00000100:00100000:0.0:1788916861.516615:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140709504:12345-0@lo:101: Request processed in 164us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916861.516623:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788916861.516774:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140709504:0@lo:101: 00010000:00010000:2.0:1788916861.516793:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d633 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d63a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916861.516803:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d633 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d63a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916861.516866:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37278700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140709632:0@lo:256: 00000100:00100000:2.0:1788916861.516904:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916861.516944:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e40bb4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788916861.516994:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140709632 00000100:00100000:1.0:1788916861.517000:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140709632 00000100:00100000:1.0:1788916861.517046:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788916861.517053:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140709632:12345-0@lo:256: 20000000:01000000:1.0:1788916861.517070:0:5784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788916861.517091:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788916861.517094:0:5784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788916861.517215:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140709632:12345-0@lo:256: Request processed in 161us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916861.517222:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788916861.517288:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37278700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140709632:0@lo:256: 10000000:01000000:2.0:1788916861.517412:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788916861.517420:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d633 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d63a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916861.517430:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d63a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788916861.517440:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788916861.517442:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788916861.517445:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788916861.517463:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc000/0x51de7f756a83d641 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916861.517472:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc000/0x51de7f756a83d641 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916861.517481:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc000/0x51de7f756a83d641 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916861.517492:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37278700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140709760:0@lo:101: 00000100:00100000:2.0:1788916861.517518:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916861.517547:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e40bb4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788916861.517983:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140709760 00000100:00100000:1.0:1788916861.517989:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140709760 00000100:00100000:1.0:1788916861.518046:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788916861.518054:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140709760:12345-0@lo:101: 00010000:00010000:1.0:1788916861.518064:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916861.518078:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d648 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d641 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916861.518101:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d641 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916861.518110:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d641 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916861.518118:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168ec00, rc 0) 00000100:00100000:1.0:1788916861.518182:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140709760:12345-0@lo:101: Request processed in 129us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916861.518189:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788916861.518448:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37278700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140709760:0@lo:101: 00010000:00010000:2.0:1788916861.518465:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc000/0x51de7f756a83d641 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d648 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916861.518473:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc000/0x51de7f756a83d641 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d648 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916861.518555:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37278700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140709888:0@lo:501: 00000100:00100000:2.0:1788916861.518585:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916861.518617:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e40bb4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788916861.518663:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140709888 00000100:00100000:1.0:1788916861.518667:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140709888 00000100:00100000:1.0:1788916861.518698:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788916861.518705:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140709888:12345-0@lo:501: 00000100:00100000:1.0:1788916861.519246:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140709888:12345-0@lo:501: Request processed in 538us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916861.519254:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788916861.519495:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37278700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140709888:0@lo:501: 00000100:00100000:2.0:1788916861.519539:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37278700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140710016:0@lo:503: 00000100:00100000:2.0:1788916861.519589:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916861.519615:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e40bb4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788916861.519631:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140710016 00000100:00100000:2.0:1788916861.519635:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140710016 00000100:00100000:2.0:1788916861.519666:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788916861.519674:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140710016:12345-0@lo:503: 00000100:00100000:2.0:1788916861.520016:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140710016:12345-0@lo:503: Request processed in 341us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916861.520024:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788916861.520091:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37278700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140710016:0@lo:503: 00000100:00100000:0.0:1788916861.524645:0:7869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:7869:1875815140710144:0@lo:502: 00000100:00100000:0.0:1788916861.524772:0:7869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916861.524826:0:7869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01eff900 going to sleep for 11 seconds 00000100:00100000:2.0:1788916861.524888:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140710144 00000100:00100000:2.0:1788916861.524897:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140710144 00000100:00100000:2.0:1788916861.524955:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788916861.524967:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+18:7869:x1875815140710144:12345-0@lo:502: 00000100:00100000:2.0:1788916861.525660:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+18:7869:x1875815140710144:12345-0@lo:502: Request processed in 692us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916861.525669:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788916861.525839:0:7869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:7869:1875815140710144:0@lo:502: 00000020:01000000:0.0:1788916861.525884:0:7869:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788916861.525895:0:7869:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788916861.525905:0:7869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788916861.525908:0:7869:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788916861.525915:0:7869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788916861.525920:0:7869:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:0.0:1788916861.525954:0:7869:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788916861.525957:0:7869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788916861.525978:0:7869:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a6e1fe93380) 00000020:00000080:0.0:1788916861.526021:0:7869:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788916861.526040:0:7869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788916861.526169:0:7869:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788916861.526176:0:7869:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788916861.526188:0:7869:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x51de7f756a83d656 00010000:00080000:0.0:1788916861.526228:0:7869:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6e1ecf8000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1788916861.526671:0:7869:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788916861.529797:0:7869:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788916861.529824:0:7869:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788916861.531846:0:7869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788916861.537598:0:7869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788916861.537744:0:7869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788916861.537831:0:7869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788916861.538363:0:7870:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788916861.538368:0:7870:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788916861.539519:0:7869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788916861.539536:0:7869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788916861.539593:0:7869:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788916861.539625:0:7869:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x51de7f756a83d65d 00000100:00080000:0.0:1788916861.539642:0:7869:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788916861.539650:0:7869:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a6e1ecf8000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1788916861.539702:0:7869:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e2d0b2680 x1875815140710272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788916861.539789:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140710272:0@lo:8: 00000100:00100000:3.0:1788916861.540450:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788916861.540606:0:7869:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788916861.540698:0:7869:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788916861.540705:0:7869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788916861.540708:0:7869:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788916861.540712:0:7869:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788916861.540727:0:7869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788916861.540729:0:7869:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788916861.540732:0:7869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788916861.540759:0:7869:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788916861.540804:0:7869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:7869:1875815140710400:0@lo:502: 00000100:00100000:0.0:1788916861.540880:0:7869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916861.540921:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140710400 00000100:00100000:0.0:1788916861.540930:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140710400 00000100:00100000:0.0:1788916861.540986:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788916861.540998:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:7869:x1875815140710400:12345-0@lo:502: 00000100:00100000:0.0:1788916861.541502:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:7869:x1875815140710400:12345-0@lo:502: Request processed in 503us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916861.541511:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788916861.541583:0:7869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01effcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916861.541620:0:7869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:7869:1875815140710400:0@lo:502: 00000020:01000000:0.0:1788916861.541659:0:7869:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788916861.541665:0:7869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788916861.541666:0:7869:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788916861.541673:0:7869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788916861.541761:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788916861.541787:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788916861.541802:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc000/0x51de7f756a83d641 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d648 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.541817:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc000/0x51de7f756a83d641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d648 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788916861.541831:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788916861.541835:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a6e0a73b380 from 1 10000000:01000000:0.0:1788916861.541839:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788916861.541878:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2200/0x51de7f756a83d664 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.541899:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2200/0x51de7f756a83d664 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.541911:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2200/0x51de7f756a83d664 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916861.541928:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140710528:0@lo:101: 00000100:00100000:0.0:1788916861.541958:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916861.541976:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01effcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916861.541993:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140710528 00000100:00100000:0.0:1788916861.541998:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140710528 00000100:00100000:2.0:1788916861.542264:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140710656:0@lo:400: 00000100:00100000:2.0:1788916861.542300:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916861.542345:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788916861.542351:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3727ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140710784:0@lo:400: 00000100:00100000:2.0:1788916861.542372:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916861.542545:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788916861.542556:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140710528:12345-0@lo:101: 00010000:00010000:0.0:1788916861.542572:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916861.542588:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d66b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d664 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.542616:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d66b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d664 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.542629:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d66b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d664 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916861.542639:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2800, rc 0) 00000100:00100000:0.0:1788916861.542675:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140710528:12345-0@lo:101: Request processed in 121us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916861.542682:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788916861.542982:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140710528:0@lo:101: 00010000:00010000:2.0:1788916861.543000:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2200/0x51de7f756a83d664 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d66b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916861.543013:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2200/0x51de7f756a83d664 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d66b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916861.543100:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3727a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140711168:0@lo:501: 00000100:00100000:2.0:1788916861.543365:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916861.543398:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e40bb4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788916861.543421:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140711168 00000100:00100000:2.0:1788916861.543427:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140711168 00000100:00100000:2.0:1788916861.543461:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788916861.543468:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0325c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140711168:12345-0@lo:501: 00000100:00100000:2.0:1788916861.543768:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0325c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140711168:12345-0@lo:501: Request processed in 298us (402us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788916861.543776:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788916861.543822:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3727a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140711168:0@lo:501: 10000000:01000000:2.0:1788916861.543856:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788916861.543864:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2200/0x51de7f756a83d664 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d66b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916861.543873:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2200/0x51de7f756a83d664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d66b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916861.544196:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37279180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140711040:0@lo:400: 00000100:00100000:0.0:1788916861.544239:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916861.544270:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788916861.544277:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140710912:0@lo:400: 00000100:00100000:0.0:1788916861.544303:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916861.544423:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140710656 00000100:00100000:2.0:1788916861.544430:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140710656 00000100:00100000:2.0:1788916861.544459:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140710784 00000100:00100000:2.0:1788916861.544462:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140710784 00000100:00100000:2.0:1788916861.544492:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140711040 00000100:00100000:2.0:1788916861.544495:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140711040 00000100:00100000:2.0:1788916861.544509:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788916861.544515:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140710656:12345-0@lo:400: 00000100:00100000:2.0:1788916861.544565:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140710656:12345-0@lo:400: Request processed in 49us (2263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916861.544571:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788916861.544584:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788916861.544590:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3727bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140710784:12345-0@lo:400: 00000100:00100000:2.0:1788916861.544619:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3727bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140710784:12345-0@lo:400: Request processed in 30us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916861.544626:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788916861.544636:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788916861.544642:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140711040:12345-0@lo:400: 00000100:00100000:2.0:1788916861.544671:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140711040:12345-0@lo:400: Request processed in 30us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916861.544677:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788916861.544727:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e3727ad80 x1875815140710784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916861.544742:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3727ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140710784:0@lo:400: 00010000:00080000:2.0:1788916861.544756:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e37278700 x1875815140710656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916861.544772:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140710656:0@lo:400: 00000100:00080000:2.0:1788916861.545020:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788916861.545245:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e37279180 x1875815140711040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916861.545256:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37279180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140711040:0@lo:400: 00000100:00100000:1.0:1788916861.545409:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140710272 00000100:00100000:1.0:1788916861.545424:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140710272 00000100:00100000:1.0:1788916861.545504:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140710912 00000100:00100000:1.0:1788916861.545508:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140710912 00000100:00080000:0.0:1788916861.545571:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788916861.545603:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788916861.545612:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140710912:12345-0@lo:400: 00000100:00100000:2.0:1788916861.545673:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140710912:12345-0@lo:400: Request processed in 62us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916861.545680:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788916861.545696:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788916861.545700:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1875815140710272:12345-0@lo:8: 00010000:00080000:2.0:1788916861.545743:0:6592:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:2.0:1788916861.545778:0:6592:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x51de7f756a83d672 00002000:00100000:2.0:1788916861.545799:0:6592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a6e3fe08000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211371a ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788916861.545804:0:6592:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788916861.545809:0:6592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788916861.545961:0:6592:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788916861.546208:0:6592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788916861.546248:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9a6e3fe0d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788916861.546307:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875815140710272:12345-0@lo:8: Request processed in 605us (5861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916861.546480:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788916861.546579:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e37278e00 x1875815140710912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916861.546592:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140710912:0@lo:400: 00010000:00080000:3.0:1788916861.546698:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2d0b2680 x1875815140710272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788916871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916861.546708:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788916861.546727:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788916861.546741:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788916861.546748:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788916861.546764:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e1ecf8000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788916861.546822:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788916861.546831:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140710272:0@lo:8: 00000004:00080000:3.0:1788916861.546862:0:7870:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788916861.547018:0:7870:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 257578870715ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788916861.603862:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788916861.656392:0:7871:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788916861.656452:0:7871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7871:1875815140711424:0@lo:7: 00000100:00100000:3.0:1788916861.656559:0:7871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916861.656631:0:7871:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cdae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788916861.656767:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140711296:0@lo:13: 00000100:00100000:2.0:1788916861.656810:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916861.657390:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140711424 00000100:00100000:1.0:1788916861.657402:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140711424 00000100:00100000:1.0:1788916861.657490:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788916861.657502:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7871:x1875815140711424:12345-0@lo:7: 00000100:00080000:2.0:1788916861.661088:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788916861.661343:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140711296 00000100:00100000:0.0:1788916861.661364:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140711296 00000100:00100000:0.0:1788916861.661493:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788916861.661508:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875815140711296:12345-0@lo:13: 00002000:00000024:0.0:1788916861.661566:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788916861.661706:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37278700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875815140711296:12345-0@lo:13: Request processed in 201us (4894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916861.661726:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788916861.661822:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e1edf2d80 x1875815140711296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916861.661872:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140711296:0@lo:13: 00002000:00080000:1.0:1788916861.664911:0:6593:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788916861.664924:0:6593:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788916861.665193:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7871:x1875815140711424:12345-0@lo:7: Request processed in 7687us (8628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916861.665208:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788916861.665499:0:7871:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e1edf0e00 x1875815140711424/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788916877 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916861.665520:0:7871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7871:1875815140711424:0@lo:7: 00000004:00080000:3.0:1788916861.665540:0:7871:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788916861.665598:0:7871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7871:1875815140711552:0@lo:5: 00000100:00100000:3.0:1788916861.665646:0:7871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916861.665738:0:7871:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cdae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788916861.665778:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140711552 00000100:00100000:2.0:1788916861.665788:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140711552 00000100:00100000:2.0:1788916861.665876:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788916861.665887:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7871:x1875815140711552:12345-0@lo:5: 00002000:00080000:2.0:1788916861.665925:0:6592:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788916861.665931:0:6592:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788916861.666595:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7871:x1875815140711552:12345-0@lo:5: Request processed in 708us (947us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788916861.666604:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788916861.666857:0:7871:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e1edf0e00 x1875815140711552/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788916877 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916861.666873:0:7871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7871:1875815140711552:0@lo:5: 00000004:00080000:0.0:1788916861.666885:0:7871:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788916861.666924:0:7871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7871:1875815140711680:0@lo:700: 00000100:00100000:0.0:1788916861.666966:0:7871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916861.667036:0:7871:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b1839c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788916861.667136:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140711680 00000100:00100000:3.0:1788916861.667407:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140711680 00000100:00100000:3.0:1788916861.667495:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788916861.667505:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7871:x1875815140711680:12345-0@lo:700: 00000100:00100000:3.0:1788916861.667545:0:6600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6600:1875815140711808:0@lo:700: 00000100:00100000:3.0:1788916861.667581:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916861.667608:0:6600:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cda900 going to sleep for 11 seconds 00000100:00100000:0.0:1788916861.667667:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140711808 00000100:00100000:0.0:1788916861.667672:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140711808 00000100:00100000:0.0:1788916861.667706:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788916861.667723:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6600:x1875815140711808:12345-0@lo:700: 00010000:00010000:3.0:1788916861.730490:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:0.0:1788916861.731657:0:5799:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788916861.744813:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6600:x1875815140711808:12345-0@lo:700: Request processed in 77084us (77215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916861.744832:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788916861.746752:0:6600:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e1edf3b80 x1875815140711808/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788916877 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916861.746780:0:6600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6600:1875815140711808:0@lo:700: 40000000:02000000:1.0:1788916861.746806:0:6600:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1788916861.903168:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788916861.903228:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788916861.904281:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7871:x1875815140711680:12345-0@lo:700: Request processed in 236769us (237305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916861.904298:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788916861.906386:0:7871:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2d0b3b80 x1875815140711680/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788916877 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916861.906406:0:7871:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788916861.906431:0:7871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7871:1875815140711680:0@lo:700: 00000004:02000040:1.0:1788916862.000723:0:7871:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788916862.005854:0:7871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7871:1875815140711936:0@lo:5: 00000100:00100000:1.0:1788916862.005953:0:7871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916862.006285:0:7871:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e054f6480 going to sleep for 11 seconds 00000100:00100000:3.0:1788916862.006751:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140711936 00000100:00100000:3.0:1788916862.006764:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140711936 00000100:00100000:3.0:1788916862.006886:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788916862.006899:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7871:x1875815140711936:12345-0@lo:5: 00002000:00080000:1.0:1788916862.016973:0:6593:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788916862.017004:0:6593:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788916862.033357:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a771f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7871:x1875815140711936:12345-0@lo:5: Request processed in 26442us (27386us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788916862.033376:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788916862.036546:0:7871:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e0a770000 x1875815140711936/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788916878 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916862.036575:0:7871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7871:1875815140711936:0@lo:5: 00000004:00080000:0.0:1788916862.036604:0:7871:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788916862.497413:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788916862.497450:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140712064:0@lo:13: 00000100:00100000:0.0:1788916862.497552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916862.499199:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140712064 00000100:00100000:1.0:1788916862.499222:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140712064 00000100:00100000:1.0:1788916862.499316:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788916862.499333:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140712064:12345-0@lo:13: 00002000:00000024:1.0:1788916862.499390:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916862.499512:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140712064:12345-0@lo:13: Request processed in 185us (1960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916862.499520:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788916862.499879:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e0a772d80 x1875815140712064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916862.499918:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a772d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140712064:0@lo:13: 00010000:00010000:1.0:1788916862.755717:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916863.775660:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916864.801257:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916865.826018:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916866.599111:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140712192:0@lo:400: 00000100:00100000:0.0:1788916866.599229:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916866.599279:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140712704:0@lo:400: 00000100:00100000:0.0:1788916866.599309:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916866.599340:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788916866.599346:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140712320:0@lo:400: 00000100:00100000:0.0:1788916866.599389:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916866.599409:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140712832:0@lo:400: 00000100:00100000:0.0:1788916866.599459:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916866.599491:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140712448:0@lo:400: 00000100:00100000:0.0:1788916866.599537:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916866.599557:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788916866.599563:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140712576:0@lo:400: 00000100:00100000:0.0:1788916866.599599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916866.599638:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140712192 00000100:00100000:0.0:1788916866.599647:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140712192 00000100:00100000:0.0:1788916866.599708:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788916866.599718:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0325e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140712192:12345-0@lo:400: 00000100:00100000:0.0:1788916866.599786:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0325e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140712192:12345-0@lo:400: Request processed in 69us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916866.599794:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788916866.599832:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140712704 00000100:00100000:0.0:1788916866.599836:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140712704 00000100:00100000:0.0:1788916866.599868:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140712320 00000100:00100000:0.0:1788916866.599872:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140712320 00000100:00100000:0.0:1788916866.599884:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140712448 00000100:00100000:0.0:1788916866.599887:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140712448 00000100:00100000:0.0:1788916866.599902:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788916866.599907:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140712704:12345-0@lo:400: 00000100:00100000:0.0:1788916866.599941:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140712704:12345-0@lo:400: Request processed in 34us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916866.599947:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788916866.599959:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788916866.599965:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140712320:12345-0@lo:400: 00000100:00100000:0.0:1788916866.599991:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140712320:12345-0@lo:400: Request processed in 26us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916866.600003:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788916866.600014:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788916866.600019:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140712448:12345-0@lo:400: 00000100:00100000:0.0:1788916866.600053:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140712448:12345-0@lo:400: Request processed in 33us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916866.600059:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788916866.600081:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140712832 00000100:00100000:0.0:1788916866.600086:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140712832 00000100:00100000:0.0:1788916866.600113:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140712576 00000100:00100000:0.0:1788916866.600116:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140712576 00000100:00100000:0.0:1788916866.600129:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788916866.600135:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875815140712832:12345-0@lo:400: 00000100:00100000:0.0:1788916866.600197:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875815140712832:12345-0@lo:400: Request processed in 60us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916866.600203:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788916866.600213:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788916866.600218:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140712576:12345-0@lo:400: 00000100:00100000:0.0:1788916866.600245:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140712576:12345-0@lo:400: Request processed in 27us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916866.600252:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788916866.600277:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788916866.600281:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788916866.600284:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788916866.600317:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2d0b0000 x1875815140712576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916866.600332:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140712576:0@lo:400: 00010000:00080000:0.0:1788916866.600353:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2d0b2a00 x1875815140712448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916866.600361:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140712448:0@lo:400: 00010000:00080000:0.0:1788916866.600392:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2d0b3100 x1875815140712320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916866.600401:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140712320:0@lo:400: 00010000:00080000:0.0:1788916866.600410:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2d0b0380 x1875815140712832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916866.600420:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140712832:0@lo:400: 00000100:00100000:0.0:1788916866.600428:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140712192:0@lo:400: 00010000:00080000:0.0:1788916866.600438:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2d0b1f80 x1875815140712704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788916882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916866.600446:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140712704:0@lo:400: 00010000:00010000:1.0:1788916866.849519:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916867.105346:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3727ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140712960:0@lo:13: 00000100:00100000:2.0:1788916867.105595:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916867.105704:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140712960 00000100:00100000:2.0:1788916867.105714:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140712960 00000100:00100000:2.0:1788916867.105771:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788916867.105781:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3727a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875815140712960:12345-0@lo:13: 00002000:00000024:2.0:1788916867.105827:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788916867.105881:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3727a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875815140712960:12345-0@lo:13: Request processed in 101us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916867.105888:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788916867.105932:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e3727ad80 x1875815140712960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916867.105953:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3727ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140712960:0@lo:13: 00000001:00080000:3.0:1788916867.262584:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1788916867.624504:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788916867.624538:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140713088:0@lo:13: 00000100:00100000:1.0:1788916867.624642:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916867.624744:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140713088 00000100:00100000:1.0:1788916867.624756:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140713088 00000100:00100000:1.0:1788916867.624817:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788916867.624827:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a770700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140713088:12345-0@lo:13: 00002000:00000024:1.0:1788916867.624877:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916867.624934:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a770700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140713088:12345-0@lo:13: Request processed in 106us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916867.624944:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788916867.625000:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e0a770e00 x1875815140713088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916867.625036:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a770e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140713088:0@lo:13: 00010000:00010000:1.0:1788916867.871333:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916868.015463:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916868.015914:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113425024 00000100:00100000:2.0:1788916868.015928:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113425024 00000100:00100000:2.0:1788916868.015997:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:2.0:1788916868.016020:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0dd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2370:x1875815113425024:12345-192.168.202.40@tcp:250: 00010000:00080000:2.0:1788916868.016058:0:5784:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from f367f55b-9b55-442e-a009-d3d404e176a2@192.168.202.40@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:2.0:1788916868.016102:0:5784:0:(genops.c:1407:class_connect()) connect: client f367f55b-9b55-442e-a009-d3d404e176a2, cookie 0x51de7f756a83d679 00000100:00080000:2.0:1788916868.017171:0:5784:0:(import.c:65:import_set_state_nolock()) ffff9a6e3fe0c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788916868.017349:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0dd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+5:2370:x1875815113425024:12345-192.168.202.40@tcp:250: Request processed in 1325us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916868.017360:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:3.0:1788916868.034555:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916868.034684:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113425152 00000100:00100000:0.0:1788916868.034699:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113425152 00000100:00100000:0.0:1788916868.034771:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:0.0:1788916868.034784:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+5:5579:x1875815113425152:12345-192.168.202.40@tcp:101: 00010000:00010000:0.0:1788916868.034807:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916868.034833:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee3e00/0x51de7f756a83d680 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f39b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916868.034874:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee3e00/0x51de7f756a83d680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f39b expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916868.034904:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee3e00/0x51de7f756a83d680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f39b expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916868.034916:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3e00, rc 0) 00000100:00100000:0.0:1788916868.034987:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+6:5579:x1875815113425152:12345-192.168.202.40@tcp:101: Request processed in 205us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916868.034995:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:2.0:1788916868.046538:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916868.046636:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113425280 00000100:00100000:0.0:1788916868.046649:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113425280 00000100:00100000:0.0:1788916868.046746:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 117 00000100:00100000:0.0:1788916868.046759:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+6:5579:x1875815113425280:12345-192.168.202.40@tcp:501: 00000100:00100000:0.0:1788916868.047249:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+6:5579:x1875815113425280:12345-192.168.202.40@tcp:501: Request processed in 492us (725us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788916868.047259:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 117 00000100:00100000:0.0:1788916868.056278:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916868.056360:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113425408 00000100:00100000:1.0:1788916868.056378:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113425408 00000100:00100000:1.0:1788916868.056463:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:1.0:1788916868.056476:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+6:5579:x1875815113425408:12345-192.168.202.40@tcp:101: 00010000:00010000:1.0:1788916868.056503:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916868.056532:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e0168e200/0x51de7f756a83d687 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f3a2 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916868.056576:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0168e200/0x51de7f756a83d687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3a2 expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916868.056591:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e0168e200/0x51de7f756a83d687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3a2 expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916868.056602:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168e200, rc 0) 00000100:00100000:1.0:1788916868.057098:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+7:5579:x1875815113425408:12345-192.168.202.40@tcp:101: Request processed in 620us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916868.057107:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:3.0:1788916868.062130:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916868.062537:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113425536 00000100:00100000:2.0:1788916868.062568:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113425536 00000100:00100000:2.0:1788916868.062638:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 119 00000100:00100000:2.0:1788916868.062648:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+7:5579:x1875815113425536:12345-192.168.202.40@tcp:501: 00000100:00100000:2.0:1788916868.063030:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+8:5579:x1875815113425536:12345-192.168.202.40@tcp:501: Request processed in 383us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916868.063039:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 119 00000100:00100000:2.0:1788916868.073372:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916868.073601:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113425664 00000100:00100000:3.0:1788916868.073615:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113425664 00000100:00100000:3.0:1788916868.073750:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00100000:3.0:1788916868.073763:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+8:5579:x1875815113425664:12345-192.168.202.40@tcp:503: 00000100:00100000:3.0:1788916868.074602:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+8:5579:x1875815113425664:12345-192.168.202.40@tcp:503: Request processed in 837us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916868.074614:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00100000:1.0:1788916868.083311:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916868.083736:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113425792 00000100:00100000:0.0:1788916868.083751:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113425792 00000100:00100000:0.0:1788916868.083822:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 121 00000100:00100000:0.0:1788916868.083834:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+8:5597:x1875815113425792:12345-192.168.202.40@tcp:502: 00000100:00100000:0.0:1788916868.084609:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+8:5597:x1875815113425792:12345-192.168.202.40@tcp:502: Request processed in 772us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916868.084621:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 121 00000100:00100000:2.0:1788916868.141633:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916868.146369:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113425920 00000100:00100000:0.0:1788916868.146389:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113425920 00000100:00100000:0.0:1788916868.146483:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:0.0:1788916868.146494:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+8:5597:x1875815113425920:12345-192.168.202.40@tcp:502: 00000100:00100000:0.0:1788916868.147466:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+8:5597:x1875815113425920:12345-192.168.202.40@tcp:502: Request processed in 969us (5840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916868.147478:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:2.0:1788916868.160740:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916868.160850:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113426048 00000100:00100000:1.0:1788916868.160865:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113426048 00000100:00100000:1.0:1788916868.161090:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00100000:1.0:1788916868.161104:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+8:5579:x1875815113426048:12345-192.168.202.40@tcp:101: 00010000:00010000:1.0:1788916868.161180:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916868.161205:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e0168f400/0x51de7f756a83d68e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f3cc expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916868.161246:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0168f400/0x51de7f756a83d68e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3cc expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916868.163114:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e0168f400/0x51de7f756a83d68e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3cc expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916868.163129:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f400, rc 0) 00000100:00100000:1.0:1788916868.163238:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+9:5579:x1875815113426048:12345-192.168.202.40@tcp:101: Request processed in 2136us (2510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916868.163248:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00100000:1.0:1788916868.175793:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916868.175889:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113426176 00000100:00100000:0.0:1788916868.175903:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113426176 00000100:00100000:0.0:1788916868.175970:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:0.0:1788916868.175983:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+9:5579:x1875815113426176:12345-192.168.202.40@tcp:256: 20000000:01000000:0.0:1788916868.176019:0:5787:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788916868.176045:0:5787:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788916868.176049:0:5787:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788916868.176052:0:5787:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788916868.176055:0:5787:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788916868.181748:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+9:5579:x1875815113426176:12345-192.168.202.40@tcp:256: Request processed in 5748us (5951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916868.181770:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:1.0:1788916868.197292:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916868.197459:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113426304 00000100:00100000:0.0:1788916868.197473:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113426304 00000100:00100000:0.0:1788916868.197552:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:0.0:1788916868.197565:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+9:5579:x1875815113426304:12345-192.168.202.40@tcp:101: 00010000:00010000:0.0:1788916868.197590:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916868.197616:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee2a00/0x51de7f756a83d695 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f3d3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916868.197692:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee2a00/0x51de7f756a83d695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3d3 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916868.197708:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee2a00/0x51de7f756a83d695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3d3 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916868.197721:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2a00, rc 0) 00000100:00100000:0.0:1788916868.197808:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+10:5579:x1875815113426304:12345-192.168.202.40@tcp:101: Request processed in 245us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916868.197831:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:2.0:1788916868.201138:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916868.201244:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113426432 00000100:00100000:3.0:1788916868.201269:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113426432 00000100:00100000:3.0:1788916868.201345:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 126 00000100:00100000:3.0:1788916868.201359:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+10:5579:x1875815113426432:12345-192.168.202.40@tcp:501: 00000100:00100000:3.0:1788916868.202442:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+10:5579:x1875815113426432:12345-192.168.202.40@tcp:501: Request processed in 1080us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916868.202454:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 126 00000100:00100000:3.0:1788916868.205193:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916868.205359:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113426560 00000100:00100000:1.0:1788916868.205373:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113426560 00000100:00100000:1.0:1788916868.205447:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 127 00000100:00100000:1.0:1788916868.205460:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+10:5579:x1875815113426560:12345-192.168.202.40@tcp:503: 00000100:00100000:1.0:1788916868.205981:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+10:5579:x1875815113426560:12345-192.168.202.40@tcp:503: Request processed in 508us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916868.205991:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 127 00000100:00100000:0.0:1788916868.212878:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916868.212998:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113426688 00000100:00100000:1.0:1788916868.213012:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113426688 00000100:00100000:1.0:1788916868.213083:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:1.0:1788916868.213095:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+10:5602:x1875815113426688:12345-192.168.202.40@tcp:502: 00000100:00100000:1.0:1788916868.213492:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+10:5602:x1875815113426688:12345-192.168.202.40@tcp:502: Request processed in 399us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916868.213502:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:1.0:1788916868.216634:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916868.216751:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113426816 00000100:00100000:2.0:1788916868.216765:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113426816 00000100:00100000:2.0:1788916868.216837:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:2.0:1788916868.216848:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+10:5602:x1875815113426816:12345-192.168.202.40@tcp:502: 00000100:00100000:2.0:1788916868.217182:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+10:5602:x1875815113426816:12345-192.168.202.40@tcp:502: Request processed in 334us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916868.217192:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:1.0:1788916868.221819:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916868.222014:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113426944 00000100:00100000:3.0:1788916868.222030:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113426944 00000100:00100000:3.0:1788916868.222085:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:3.0:1788916868.222094:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2370:x1875815113426944:12345-192.168.202.40@tcp:38: 00010000:00080000:3.0:1788916868.222132:0:5792:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:3.0:1788916868.222208:0:5792:0:(genops.c:1407:class_connect()) connect: client 9afe8ff0-67c2-4292-b970-4ecb57096cb4, cookie 0x51de7f756a83d69c 00000004:00100000:3.0:1788916868.222246:0:5792:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788916868.222267:0:5792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788916868.256055:0:5792:0:(import.c:65:import_set_state_nolock()) ffff9a6e07589800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788916868.256181:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a770e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2370:x1875815113426944:12345-192.168.202.40@tcp:38: Request processed in 34084us (34375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916868.256193:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00010000:00010000:1.0:1788916868.895394:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916869.274835:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916869.274925:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916869.275001:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113427200 00000100:00100000:2.0:1788916869.275015:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113427200 00000100:00100000:2.0:1788916869.275098:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113427072 00000100:00100000:2.0:1788916869.275101:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113427072 00000100:00100000:2.0:1788916869.275125:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:2.0:1788916869.275137:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:5579:x1875815113427200:12345-192.168.202.40@tcp:41: 00000004:00000024:2.0:1788916869.275229:0:5793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788916869.275327:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:5579:x1875815113427200:12345-192.168.202.40@tcp:41: Request processed in 191us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916869.275335:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:2.0:1788916869.275356:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:2.0:1788916869.275363:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:0:x1875815113427072:12345-192.168.202.40@tcp:41: 00000004:00000024:2.0:1788916869.275375:0:5793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788916869.275400:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:0:x1875815113427072:12345-192.168.202.40@tcp:41: Request processed in 38us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916869.275406:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00080000:1.0:1788916869.275535:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788916869.282142:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916869.282409:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113427328 00000100:00100000:3.0:1788916869.282424:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113427328 00000100:00100000:3.0:1788916869.282513:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:3.0:1788916869.282524:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:5579:x1875815113427328:12345-192.168.202.40@tcp:40: 00000100:00100000:3.0:1788916869.282683:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a772d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:5579:x1875815113427328:12345-192.168.202.40@tcp:40: Request processed in 159us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916869.282692:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1788916869.295599:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916869.295678:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916869.295926:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113427840 00000100:00100000:2.0:1788916869.295941:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113427840 00000100:00100000:2.0:1788916869.296042:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:2.0:1788916869.296054:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:5579:x1875815113427840:12345-192.168.202.40@tcp:33: 00000100:00100000:1.0:1788916869.302655:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113427584 00000100:00100000:1.0:1788916869.302681:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113427584 00000100:00100000:1.0:1788916869.302803:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 130 00000100:00100000:1.0:1788916869.302818:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+10:2371:x1875815113427584:12345-192.168.202.40@tcp:400: 00000100:00100000:1.0:1788916869.302948:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+10:2371:x1875815113427584:12345-192.168.202.40@tcp:400: Request processed in 134us (7361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916869.302969:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 130 00000100:00100000:0.0:1788916869.305473:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916869.305527:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916869.305616:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113427456 00000100:00100000:2.0:1788916869.305634:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113427456 00000100:00100000:2.0:1788916869.305709:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113427712 00000100:00100000:2.0:1788916869.305712:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113427712 00000100:00100000:2.0:1788916869.305744:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:2.0:1788916869.305755:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2370:x1875815113427456:12345-192.168.202.40@tcp:8: 00010000:00080000:2.0:1788916869.305805:0:6592:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:2.0:1788916869.305875:0:6592:0:(genops.c:1407:class_connect()) connect: client 9afe8ff0-67c2-4292-b970-4ecb57096cb4, cookie 0x51de7f756a83d6a3 00002000:00100000:2.0:1788916869.305905:0:6592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9afe8ff0-67c2-4292-b970-4ecb57096cb4/ffff9a6e3fe0b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788916869.305943:0:6592:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788916869.306529:0:6592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788916869.306587:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9a6e2d528800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788916869.306743:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2370:x1875815113427456:12345-192.168.202.40@tcp:8: Request processed in 984us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916869.306756:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:2.0:1788916869.306802:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:2.0:1788916869.306810:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2370:x1875815113427712:12345-192.168.202.40@tcp:8: 00010000:00080000:2.0:1788916869.306835:0:6592:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:2.0:1788916869.306868:0:6592:0:(genops.c:1407:class_connect()) connect: client 9afe8ff0-67c2-4292-b970-4ecb57096cb4, cookie 0x51de7f756a83d6aa 00002000:00100000:2.0:1788916869.306879:0:6592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9afe8ff0-67c2-4292-b970-4ecb57096cb4/ffff9a6e2d52b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788916869.306905:0:6592:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788916869.307214:0:6592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788916869.307242:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9a6e36a31800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788916869.307274:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2370:x1875815113427712:12345-192.168.202.40@tcp:8: Request processed in 464us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916869.307282:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000004:00080000:2.0:1788916869.336858:0:5795:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 40673us 00000004:00200000:0.0:1788916869.360410:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1788916869.360659:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:5579:x1875815113427840:12345-192.168.202.40@tcp:33: Request processed in 64583us (64955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916869.360677:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:1.0:1788916869.548028:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916869.548584:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113427968 00000100:00100000:2.0:1788916869.548604:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113427968 00000100:00100000:2.0:1788916869.548713:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:2.0:1788916869.548738:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:5620:x1875815113427968:12345-192.168.202.40@tcp:101: 00010000:00010000:2.0:1788916869.548796:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916869.548833:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d6b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f3fd expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916869.548952:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d6b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916869.548973:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916869.548990:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916869.549327:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788916869.549333:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788916869.549419:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916869.549455:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d6b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3fd expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916869.549478:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d6b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3fd expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916869.549487:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02f3c700) 00010000:00010000:2.0:1788916869.549490:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788916869.549495:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e013fdc00, rc 0) 00000100:00100000:2.0:1788916869.549593:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:5620:x1875815113427968:12345-192.168.202.40@tcp:101: Request processed in 859us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916869.549603:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00010000:00010000:1.0:1788916869.919756:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916870.943837:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916871.711549:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140713600:0@lo:400: 00000100:00100000:0.0:1788916871.711669:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916871.711770:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788916871.711777:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140713472:0@lo:400: 00000100:00100000:0.0:1788916871.711808:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916871.711853:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140713472 00000100:00100000:0.0:1788916871.711865:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140713472 00000100:00100000:0.0:1788916871.711949:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788916871.711961:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140713472:12345-0@lo:400: 00000100:00100000:0.0:1788916871.712037:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140713472:12345-0@lo:400: Request processed in 78us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916871.712066:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788916871.712094:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788916871.712179:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140713472:0@lo:400: 00000100:00100000:2.0:1788916871.712515:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140713216:0@lo:400: 00000100:00100000:1.0:1788916871.712597:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140713344:0@lo:400: 00000100:00100000:2.0:1788916871.712615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916871.712663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916871.712720:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140713728:0@lo:400: 00000100:00100000:1.0:1788916871.712721:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140713856:0@lo:400: 00000100:00100000:1.0:1788916871.712779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916871.712801:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916871.712838:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140713600 00000100:00100000:1.0:1788916871.712848:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140713600 00000100:00100000:2.0:1788916871.712891:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140713856 00000100:00100000:2.0:1788916871.712901:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140713856 00000100:00100000:1.0:1788916871.712910:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788916871.712923:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140713600:12345-0@lo:400: 00000100:00100000:2.0:1788916871.712957:0:6592:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788916871.712969:0:6592:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788916871.713000:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140713344 00000100:00100000:2.0:1788916871.713004:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140713344 00000100:00100000:1.0:1788916871.713008:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140713600:12345-0@lo:400: Request processed in 87us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916871.713018:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788916871.713043:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788916871.713050:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140713728 00000100:00100000:1.0:1788916871.713057:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140713856:12345-0@lo:400: 00000100:00100000:2.0:1788916871.713058:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140713728 00000100:00100000:2.0:1788916871.713099:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788916871.713110:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140713344:12345-0@lo:400: 00000100:00100000:1.0:1788916871.713124:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140713856:12345-0@lo:400: Request processed in 70us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916871.713135:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788916871.713367:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788916871.713373:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788916871.713376:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788916871.713408:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e3a17df80 x1875815140713856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916871.713421:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788916871.713442:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140713856:0@lo:400: 00010000:00080000:1.0:1788916871.713483:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e3a17f100 x1875815140713600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916871.713493:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140713600:0@lo:400: 00000100:00100000:1.0:1788916871.713541:0:5794:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788916871.713551:0:5794:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788916871.713584:0:5792:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788916871.713593:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788916871.713605:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3727ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140713728:12345-0@lo:400: 00000100:00100000:0.0:1788916871.715408:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140713216 00000100:00100000:0.0:1788916871.715424:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140713216 00000100:00100000:0.0:1788916871.715501:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788916871.715512:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140713216:12345-0@lo:400: 00000100:00100000:1.0:1788916871.718908:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3727ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140713728:12345-0@lo:400: Request processed in 5081us (5883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916871.718928:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788916871.720673:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140713728:0@lo:400: 00000100:00100000:0.0:1788916871.721172:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140713216:12345-0@lo:400: Request processed in 5657us (8554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916871.721186:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788916871.721408:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140713216:0@lo:400: 00000100:00100000:2.0:1788916871.722799:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140713344:12345-0@lo:400: Request processed in 9679us (10127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916871.722815:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788916871.722952:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140713344:0@lo:400: 00000100:00100000:1.0:1788916871.896178:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916871.896344:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113428096 00000100:00100000:3.0:1788916871.896356:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113428096 00000100:00100000:3.0:1788916871.896440:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:3.0:1788916871.896451:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:5672:x1875815113428096:12345-192.168.202.40@tcp:41: 00000004:00000024:3.0:1788916871.896931:0:5794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788916871.897016:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:5672:x1875815113428096:12345-192.168.202.40@tcp:41: Request processed in 566us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916871.897024:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00080000:1.0:1788916871.897126:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788916871.911772:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916871.911895:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113428224 00000100:00100000:1.0:1788916871.911906:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113428224 00000100:00100000:1.0:1788916871.911991:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:1.0:1788916871.912002:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:5672:x1875815113428224:12345-192.168.202.40@tcp:13: 00002000:00000024:1.0:1788916871.912048:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916871.912128:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:5672:x1875815113428224:12345-192.168.202.40@tcp:13: Request processed in 127us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916871.912135:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00080000:0.0:1788916871.912495:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788916871.915362:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916871.915762:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113428352 00000100:00100000:1.0:1788916871.915773:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113428352 00000100:00100000:1.0:1788916871.915910:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:1.0:1788916871.915921:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:5672:x1875815113428352:12345-192.168.202.40@tcp:13: 00002000:00000024:1.0:1788916871.915980:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916871.916066:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:5672:x1875815113428352:12345-192.168.202.40@tcp:13: Request processed in 146us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916871.916073:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00080000:0.0:1788916871.918017:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788916871.967384:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916872.224166:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788916872.224198:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3727b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140713984:0@lo:13: 00000100:00100000:1.0:1788916872.224294:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916872.224608:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140713984 00000100:00100000:2.0:1788916872.224626:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140713984 00000100:00100000:2.0:1788916872.224702:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788916872.224712:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140713984:12345-0@lo:13: 00002000:00000024:2.0:1788916872.224744:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788916872.224803:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140713984:12345-0@lo:13: Request processed in 91us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916872.224811:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788916872.225085:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e3727b800 x1875815140713984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916872.225106:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3727b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140713984:0@lo:13: 00000001:00100000:0.0:1788916872.327992:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9afe8ff0-67c2-4292-b970-4ecb57096cb4 00000100:00100000:0.0:1788916872.735464:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140714112:0@lo:13: 00000100:00100000:0.0:1788916872.735578:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916872.735738:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140714112 00000100:00100000:1.0:1788916872.735751:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140714112 00000100:00100000:1.0:1788916872.735827:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788916872.735839:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140714112:12345-0@lo:13: 00002000:00000024:1.0:1788916872.735875:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916872.735949:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140714112:12345-0@lo:13: Request processed in 111us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916872.735957:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788916872.736059:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e28d62d80 x1875815140714112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916872.736083:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140714112:0@lo:13: 00010000:00010000:1.0:1788916872.991456:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788916873.301428:0:5814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9afe8ff0-67c2-4292-b970-4ecb57096cb4 00000001:00100000:2.0:1788916873.867554:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9afe8ff0-67c2-4292-b970-4ecb57096cb4 00010000:00010000:2.0:1788916874.016411:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916874.668251:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916874.668297:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916874.668320:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916874.668347:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916874.669172:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113428480 00000100:00100000:1.0:1788916874.669198:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113428480 00000100:00100000:1.0:1788916874.669276:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 132 00000100:00100000:1.0:1788916874.669288:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+10:2372:x1875815113428480:12345-192.168.202.40@tcp:400: 00000100:00100000:1.0:1788916874.669387:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+10:2372:x1875815113428480:12345-192.168.202.40@tcp:400: Request processed in 101us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916874.669395:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 132 00000100:00100000:1.0:1788916874.669439:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113428608 00000100:00100000:1.0:1788916874.669444:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113428608 00000100:00100000:1.0:1788916874.669488:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:1.0:1788916874.669495:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2374:x1875815113428608:12345-192.168.202.40@tcp:400: 00000100:00100000:1.0:1788916874.669530:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2374:x1875815113428608:12345-192.168.202.40@tcp:400: Request processed in 36us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916874.669537:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:1.0:1788916874.669556:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113428864 00000100:00100000:1.0:1788916874.669560:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113428864 00000100:00100000:1.0:1788916874.669584:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113428736 00000100:00100000:1.0:1788916874.669587:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113428736 00000100:00100000:1.0:1788916874.669630:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:1.0:1788916874.669636:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3727b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2374:x1875815113428864:12345-192.168.202.40@tcp:400: 00000100:00100000:1.0:1788916874.669663:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3727b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2374:x1875815113428864:12345-192.168.202.40@tcp:400: Request processed in 27us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916874.669669:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:1.0:1788916874.669701:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:1.0:1788916874.669707:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3727b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2374:x1875815113428736:12345-192.168.202.40@tcp:400: 00000100:00100000:1.0:1788916874.669733:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3727b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2374:x1875815113428736:12345-192.168.202.40@tcp:400: Request processed in 26us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916874.669739:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00080000:1.0:1788916874.669760:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788916874.669765:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788916874.669768:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788916875.039291:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788916875.416718:0:8159:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788916876.064344:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916876.833336:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3727a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140714496:0@lo:400: 00000100:00100000:2.0:1788916876.833443:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916876.833518:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788916876.833524:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140714624:0@lo:400: 00000100:00100000:2.0:1788916876.833552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916876.833608:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140714624 00000100:00100000:2.0:1788916876.833619:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140714624 00000100:00100000:2.0:1788916876.833713:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788916876.833725:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140714624:12345-0@lo:400: 00000100:00100000:2.0:1788916876.833792:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140714624:12345-0@lo:400: Request processed in 69us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916876.833800:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788916876.833827:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788916876.833868:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e37279500 x1875815140714624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916876.835162:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140714624:0@lo:400: 00000100:00100000:0.0:1788916876.835445:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37279180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140714368:0@lo:400: 00000100:00100000:0.0:1788916876.835515:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916876.835561:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3727aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140714880:0@lo:400: 00000100:00100000:0.0:1788916876.835600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916876.835651:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788916876.835668:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140714240:0@lo:400: 00000100:00100000:0.0:1788916876.835701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916876.835728:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140714752:0@lo:400: 00000100:00100000:0.0:1788916876.835751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916876.835791:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140714240 00000100:00100000:0.0:1788916876.835800:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140714240 00000100:00100000:0.0:1788916876.835854:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788916876.835865:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140714240:12345-0@lo:400: 00000100:00100000:0.0:1788916876.836070:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140714240:12345-0@lo:400: Request processed in 206us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916876.836078:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788916876.836140:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140714496 00000100:00100000:0.0:1788916876.836254:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140714496 00000100:00100000:0.0:1788916876.836294:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140714368 00000100:00100000:0.0:1788916876.836297:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140714368 00000100:00100000:0.0:1788916876.836310:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140714752 00000100:00100000:0.0:1788916876.836312:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140714752 00000100:00100000:0.0:1788916876.836326:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788916876.836333:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3727b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140714496:12345-0@lo:400: 00000100:00100000:0.0:1788916876.836376:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3727b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140714496:12345-0@lo:400: Request processed in 44us (2935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916876.836383:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788916876.836403:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788916876.836409:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140714368:12345-0@lo:400: 00000100:00100000:0.0:1788916876.836439:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140714368:12345-0@lo:400: Request processed in 30us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916876.836446:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788916876.836457:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788916876.836463:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140714752:12345-0@lo:400: 00000100:00100000:0.0:1788916876.836488:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140714752:12345-0@lo:400: Request processed in 25us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916876.836494:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788916876.836535:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37278e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140714240:0@lo:400: 00000100:00100000:0.0:1788916876.836552:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140714752:0@lo:400: 00000100:00100000:0.0:1788916876.836562:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37279180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140714368:0@lo:400: 00000100:00100000:2.0:1788916876.836713:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140714880 00000100:00100000:2.0:1788916876.836719:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140714880 00000100:00100000:2.0:1788916876.836759:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788916876.836766:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140714880:12345-0@lo:400: 00000100:00100000:2.0:1788916876.836814:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140714880:12345-0@lo:400: Request processed in 48us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916876.836830:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788916876.836850:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788916876.836856:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788916876.836878:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3727a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140714496:0@lo:400: 00010000:00080000:2.0:1788916876.837179:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e3727aa00 x1875815140714880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916876.837194:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3727aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140714880:0@lo:400: 00010000:00010000:1.0:1788916877.088777:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916877.344970:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140715008:0@lo:13: 00000100:00100000:1.0:1788916877.345066:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916877.346801:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140715008 00000100:00100000:1.0:1788916877.346817:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140715008 00000100:00100000:2.0:1788916877.346938:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788916877.346951:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140715008:12345-0@lo:13: 00002000:00000024:2.0:1788916877.347003:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788916877.347105:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140715008:12345-0@lo:13: Request processed in 155us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916877.347112:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788916877.347203:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e28d60e00 x1875815140715008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916877.347227:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140715008:0@lo:13: 00000100:00100000:0.0:1788916877.856130:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788916877.856252:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140715136:0@lo:13: 00000100:00100000:0.0:1788916877.856337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916877.856734:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140715136 00000100:00100000:2.0:1788916877.856743:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140715136 00000100:00100000:2.0:1788916877.856799:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788916877.856810:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140715136:12345-0@lo:13: 00002000:00000024:2.0:1788916877.856869:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788916877.856948:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140715136:12345-0@lo:13: Request processed in 140us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916877.856956:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788916877.857000:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e3a17d880 x1875815140715136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916877.857020:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140715136:0@lo:13: 00010000:00010000:2.0:1788916878.116758:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916879.139454:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788916879.221696:0:8307:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff384470c0 20000000:00000080:3.0:1788916879.221720:0:8307:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6e3f304000 uarg=0000000000000000 20000000:01000000:3.0:1788916879.221829:0:8307:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788916879.221832:0:8307:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788916879.221835:0:8307:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788916879.221840:0:8307:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788916879.221846:0:8307:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788916879.221863:0:8307:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788916879.221866:0:8307:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788916879.222260:0:8307:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788916879.222264:0:8307:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788916879.223706:0:8308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788916879.224652:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788916879.224736:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788916879.224777:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1788916879.224798:0:8307:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788916879.224801:0:8307:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788916879.226689:0:8309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788916879.227717:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788916879.227795:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788916879.227834:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1788916879.227851:0:8307:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788916879.227853:0:8307:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788916879.241226:0:8310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788916879.242126:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788916879.242215:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788916879.242255:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1788916879.242270:0:8307:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788916879.242273:0:8307:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788916879.245702:0:8311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788916879.246358:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788916879.246484:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788916879.246545:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:2.0:1788916879.246575:0:8307:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788916879.246599:0:8307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d6bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.246618:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d5b5 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.246626:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d5e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d5df expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.246632:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d610 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d609 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.246638:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e00031400/0x51de7f756a83d61e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d617 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.246644:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e0168fc00/0x51de7f756a83d62c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d625 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.246649:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d648 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d641 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.246656:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d66b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d664 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.246666:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e06ee3e00/0x51de7f756a83d680 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f39b expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.246673:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e0168e200/0x51de7f756a83d687 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3a2 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.246689:0:8307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d6bf lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.246732:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e0168e200/0x51de7f756a83d687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3a2 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.246747:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6e0168e200/0x51de7f756a83d687 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3a2 expref: 9 pid: 5787 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.246761:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1875815140715264:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788916879.246879:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e06ee3e00/0x51de7f756a83d680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f39b expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.246887:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6e06ee3e00/0x51de7f756a83d680 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f39b expref: 9 pid: 5786 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.246896:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1875815140715392:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788916879.246927:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d66b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d664 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.246934:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d66b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d664 expref: 18 pid: 5784 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.246943:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1875815140715520:0@lo:104: 00000100:00100000:2.0:1788916879.246986:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788916879.247028:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d641 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.247047:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d648 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d641 expref: 18 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.247057:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1875815140715648:0@lo:104: 00000100:00100000:2.0:1788916879.247084:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788916879.247105:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e0168fc00/0x51de7f756a83d62c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d625 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.247112:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e0168fc00/0x51de7f756a83d62c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d625 expref: 18 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.247119:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1875815140715776:0@lo:104: 00010000:00010000:2.0:1788916879.247142:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e00031400/0x51de7f756a83d61e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d617 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.247175:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e00031400/0x51de7f756a83d61e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d617 expref: 18 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.247183:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3727aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1875815140715904:0@lo:104: 00010000:00010000:2.0:1788916879.247207:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d610 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d609 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.247214:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d610 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d609 expref: 18 pid: 5784 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.247221:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3727a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1875815140716032:0@lo:104: 00010000:00010000:2.0:1788916879.247244:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d5e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d5df expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.247264:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d5e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d5df expref: 18 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.247273:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37279180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1875815140716160:0@lo:104: 00010000:00010000:2.0:1788916879.247301:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d5b5 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.247308:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d5b5 expref: 18 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.247316:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37278380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1875815140716288:0@lo:104: 00000100:00100000:2.0:1788916879.247334:0:8307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3728dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788916879.248340:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788916879.248382:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916879.248417:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916879.248430:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916879.248439:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916879.248448:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916879.248458:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140715520 00000100:00100000:1.0:1788916879.248467:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140715520 00000100:00100000:1.0:1788916879.248513:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140715648 00000100:00100000:1.0:1788916879.248516:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140715648 00000100:00100000:1.0:1788916879.248527:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140715776 00000100:00100000:1.0:1788916879.248530:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140715776 00000100:00100000:1.0:1788916879.248540:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140715904 00000100:00100000:1.0:1788916879.248542:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140715904 00000100:00100000:1.0:1788916879.248561:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140716032 00000100:00100000:1.0:1788916879.248564:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140716032 00000100:00100000:1.0:1788916879.248575:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140716160 00000100:00100000:1.0:1788916879.248578:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140716160 00000100:00100000:1.0:1788916879.248586:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140716288 00000100:00100000:1.0:1788916879.248588:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140716288 00000100:00100000:1.0:1788916879.248601:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788916879.248610:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+9:8307:x1875815140715520:12345-0@lo:104: 00010000:00010000:1.0:1788916879.248627:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2200/0x51de7f756a83d664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d66b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.248710:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788916879.248716:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+9:8307:x1875815140715520:12345-0@lo:104: Request processed in 108us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916879.248725:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788916879.248744:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788916879.248750:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+8:8307:x1875815140715648:12345-0@lo:104: 00010000:00010000:1.0:1788916879.248770:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc000/0x51de7f756a83d641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d648 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.248823:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788916879.248828:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+8:8307:x1875815140715648:12345-0@lo:104: Request processed in 79us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916879.248834:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788916879.248868:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788916879.248874:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+7:8307:x1875815140715776:12345-0@lo:104: 00010000:00010000:1.0:1788916879.248881:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83d625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d62c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.248909:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788916879.248914:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+7:8307:x1875815140715776:12345-0@lo:104: Request processed in 41us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916879.248920:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788916879.248932:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788916879.248937:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+6:8307:x1875815140715904:12345-0@lo:104: 00010000:00010000:1.0:1788916879.248944:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83d617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d61e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.248970:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788916879.248974:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+6:8307:x1875815140715904:12345-0@lo:104: Request processed in 38us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916879.248979:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788916879.248990:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788916879.248995:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+5:8307:x1875815140716032:12345-0@lo:104: 00010000:00010000:1.0:1788916879.249009:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f800/0x51de7f756a83d609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d610 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249036:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788916879.249041:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+5:8307:x1875815140716032:12345-0@lo:104: Request processed in 47us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916879.249048:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788916879.249060:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788916879.249066:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+4:8307:x1875815140716160:12345-0@lo:104: 00010000:00010000:1.0:1788916879.249073:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e00031c00/0x51de7f756a83d5df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d5e6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249117:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788916879.249121:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+4:8307:x1875815140716160:12345-0@lo:104: Request processed in 56us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916879.249126:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788916879.249137:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788916879.249142:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+3:8307:x1875815140716288:12345-0@lo:104: 00010000:00010000:1.0:1788916879.249181:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e00031200/0x51de7f756a83d5b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d5bc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249211:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1788916879.249215:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+3:8307:x1875815140716288:12345-0@lo:104: Request processed in 74us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916879.249221:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788916879.249244:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788916879.249250:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2200/0x51de7f756a83d664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d66b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249265:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2200 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1788916879.249269:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2200/0x51de7f756a83d664 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d66b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249277:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2200/0x51de7f756a83d664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d66b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788916879.249286:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2200/0x51de7f756a83d664 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d66b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916879.249292:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788916879.249328:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2200/0x51de7f756a83d664 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d66b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249335:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788916879.249355:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2200/0x51de7f756a83d664 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d66b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249362:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2200/0x51de7f756a83d664 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d66b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249375:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788916879.249378:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc000/0x51de7f756a83d641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d648 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249384:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fc000 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1788916879.249387:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc000/0x51de7f756a83d641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d648 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249404:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc000/0x51de7f756a83d641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d648 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788916879.249410:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc000/0x51de7f756a83d641 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d648 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916879.249416:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788916879.249429:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc000/0x51de7f756a83d641 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d648 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249435:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788916879.249441:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc000/0x51de7f756a83d641 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d648 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249448:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc000/0x51de7f756a83d641 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d648 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249458:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788916879.249461:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83d625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d62c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249467:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00030000 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1788916879.249469:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83d625 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d62c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249475:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83d625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d62c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788916879.249481:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83d625 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d62c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916879.249493:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788916879.249506:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83d625 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d62c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249512:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788916879.249527:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83d625 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d62c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249534:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83d625 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d62c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249545:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788916879.249548:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83d617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d61e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249563:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031600 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1788916879.249566:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83d617 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d61e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249572:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83d617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d61e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788916879.249578:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83d617 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d61e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916879.249584:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788916879.249596:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83d617 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d61e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249601:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788916879.249614:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83d617 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d61e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249620:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83d617 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d61e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249632:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788916879.249635:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f800/0x51de7f756a83d609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d610 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249640:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f800 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1788916879.249643:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f800/0x51de7f756a83d609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d610 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249649:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f800/0x51de7f756a83d609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d610 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788916879.249656:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f800/0x51de7f756a83d609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d610 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916879.249661:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788916879.249675:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f800/0x51de7f756a83d609 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d610 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249679:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788916879.249683:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f800/0x51de7f756a83d609 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d610 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249688:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f800/0x51de7f756a83d609 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d610 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249697:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788916879.249704:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e00031c00/0x51de7f756a83d5df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d5e6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249709:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031c00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1788916879.249711:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e00031c00/0x51de7f756a83d5df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d5e6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249717:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e00031c00/0x51de7f756a83d5df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d5e6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788916879.249723:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e00031c00/0x51de7f756a83d5df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d5e6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916879.249727:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788916879.249739:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e00031c00/0x51de7f756a83d5df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d5e6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249745:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788916879.249750:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e00031c00/0x51de7f756a83d5df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d5e6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249755:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e00031c00/0x51de7f756a83d5df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d5e6 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249763:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788916879.249766:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e00031200/0x51de7f756a83d5b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d5bc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249772:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031200 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1788916879.249775:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e00031200/0x51de7f756a83d5b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d5bc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249791:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e00031200/0x51de7f756a83d5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d5bc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788916879.249798:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e00031200/0x51de7f756a83d5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d5bc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916879.249803:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788916879.249817:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e00031200/0x51de7f756a83d5b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d5bc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249822:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788916879.249826:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e00031200/0x51de7f756a83d5b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d5bc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249833:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e00031200/0x51de7f756a83d5b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d5bc expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.249847:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916879.249849:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916879.249851:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916879.249859:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916879.249886:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140716416:0@lo:103: 00000100:00100000:1.0:1788916879.249926:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916879.249953:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140716928:0@lo:103: 00000100:00100000:1.0:1788916879.249973:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916879.249994:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788916879.250000:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140716544:0@lo:103: 00000100:00100000:1.0:1788916879.250019:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916879.250044:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140717056:0@lo:103: 00000100:00100000:1.0:1788916879.250064:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916879.250092:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140716672:0@lo:103: 00000100:00100000:1.0:1788916879.250113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916879.250121:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140717184:0@lo:103: 00000100:00100000:1.0:1788916879.250137:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916879.250169:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788916879.250175:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140716800:0@lo:103: 00000100:00100000:1.0:1788916879.250197:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916879.250223:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140716416 00000100:00100000:1.0:1788916879.250229:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140716416 00010000:00010000:1.0:1788916879.250253:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d66b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d664 expref: 19 pid: 5784 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916879.250270:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140716928 00000100:00100000:1.0:1788916879.250273:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140716928 00010000:00010000:1.0:1788916879.250283:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d610 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d609 expref: 20 pid: 5784 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916879.250293:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140716544 00000100:00100000:1.0:1788916879.250296:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140716544 00010000:00010000:1.0:1788916879.250304:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d648 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d641 expref: 21 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916879.250315:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140717056 00000100:00100000:1.0:1788916879.250317:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140717056 00010000:00010000:1.0:1788916879.250326:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d5e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d5df expref: 22 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916879.250335:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140716672 00000100:00100000:1.0:1788916879.250343:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140716672 00010000:00010000:1.0:1788916879.250356:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e0168fc00/0x51de7f756a83d62c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d625 expref: 23 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916879.250367:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140717184 00000100:00100000:1.0:1788916879.250369:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140717184 00010000:00010000:1.0:1788916879.250378:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d5b5 expref: 24 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916879.250387:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140716800 00000100:00100000:1.0:1788916879.250389:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140716800 00010000:00010000:1.0:1788916879.250397:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e00031400/0x51de7f756a83d61e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d617 expref: 25 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916879.250408:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788916879.250415:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+25:3304:x1875815140716416:12345-0@lo:103: 00010000:00010000:1.0:1788916879.250426:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916879.250432:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d66b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d664 expref: 25 pid: 5784 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.250441:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d66b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d664 expref: 25 pid: 5784 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.250458:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916879.250489:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+25:3304:x1875815140716416:12345-0@lo:103: Request processed in 74us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916879.250495:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788916879.250510:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788916879.250516:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+24:3304:x1875815140716928:12345-0@lo:103: 00010000:00010000:1.0:1788916879.250524:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916879.250533:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d610 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d609 expref: 24 pid: 5784 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.250541:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d610 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d609 expref: 24 pid: 5784 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.250564:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916879.250586:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+24:3304:x1875815140716928:12345-0@lo:103: Request processed in 71us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916879.250592:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788916879.250606:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788916879.250611:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+23:3304:x1875815140716544:12345-0@lo:103: 00010000:00010000:1.0:1788916879.250619:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916879.250623:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d648 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d641 expref: 23 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.250631:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d648 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d641 expref: 23 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.250639:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916879.250658:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+23:3304:x1875815140716544:12345-0@lo:103: Request processed in 47us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916879.250663:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788916879.250674:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788916879.250679:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+22:3304:x1875815140717056:12345-0@lo:103: 00010000:00010000:1.0:1788916879.250686:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916879.250690:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d5e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d5df expref: 22 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.250710:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d5e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d5df expref: 22 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.250719:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916879.250736:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+22:3304:x1875815140717056:12345-0@lo:103: Request processed in 58us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916879.250742:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788916879.250752:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788916879.250757:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+21:3306:x1875815140716672:12345-0@lo:103: 00010000:00010000:1.0:1788916879.250763:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916879.250767:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e0168fc00/0x51de7f756a83d62c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d625 expref: 21 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.250775:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e0168fc00/0x51de7f756a83d62c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d625 expref: 21 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.250784:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916879.250805:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+21:3306:x1875815140716672:12345-0@lo:103: Request processed in 47us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916879.250810:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788916879.250819:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788916879.250824:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a770000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+20:3306:x1875815140717184:12345-0@lo:103: 00010000:00010000:1.0:1788916879.250831:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916879.250835:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d5b5 expref: 20 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.250842:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d5b5 expref: 20 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.250857:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916879.250876:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a770000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+20:3306:x1875815140717184:12345-0@lo:103: Request processed in 51us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916879.250882:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788916879.250892:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788916879.250897:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e08220c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+19:3306:x1875815140716800:12345-0@lo:103: 00010000:00010000:1.0:1788916879.250904:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916879.250908:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e00031400/0x51de7f756a83d61e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d617 expref: 19 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.250916:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e00031400/0x51de7f756a83d61e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d617 expref: 19 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916879.250924:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916879.250938:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e08220c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+19:3306:x1875815140716800:12345-0@lo:103: Request processed in 41us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916879.250944:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788916879.251005:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140716800:0@lo:103: 00000100:00100000:1.0:1788916879.251012:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140716672:0@lo:103: 00000100:00100000:1.0:1788916879.251019:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140717184:0@lo:103: 00000100:00100000:1.0:1788916879.251042:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140716544:0@lo:103: 00000100:00100000:1.0:1788916879.251049:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140717056:0@lo:103: 00000100:00100000:1.0:1788916879.251055:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140716416:0@lo:103: 00000100:00100000:1.0:1788916879.251060:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140716928:0@lo:103: 00010000:00010000:2.0:1788916879.252995:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d66b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d664 expref: 18 pid: 5784 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.253015:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1875815140715520:0@lo:104: 00010000:00010000:2.0:1788916879.253027:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0168ec00/0x51de7f756a83d648 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d641 expref: 17 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.253037:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1875815140715648:0@lo:104: 00010000:00010000:2.0:1788916879.253046:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0168fc00/0x51de7f756a83d62c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d625 expref: 16 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.253055:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1875815140715776:0@lo:104: 00010000:00010000:2.0:1788916879.253064:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e00031400/0x51de7f756a83d61e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d617 expref: 15 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.253075:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3727aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1875815140715904:0@lo:104: 00010000:00010000:2.0:1788916879.253108:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d610 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d609 expref: 14 pid: 5784 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.253118:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3727a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1875815140716032:0@lo:104: 00010000:00010000:2.0:1788916879.253126:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e00030e00/0x51de7f756a83d5e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d5df expref: 13 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.253135:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37279180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1875815140716160:0@lo:104: 00010000:00010000:2.0:1788916879.253166:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d5bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d5b5 expref: 12 pid: 5787 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.253176:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37278380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1875815140716288:0@lo:104: 00000100:00100000:0.0:1788916879.259695:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1875815140715264:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788916879.259713:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1875815140715392:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788916879.259767:0:8307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d6bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916879.265266:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916879.265305:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916879.265464:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113428992 00000100:00100000:2.0:1788916879.265476:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113428992 00010000:00010000:2.0:1788916879.265522:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e06ee3e00/0x51de7f756a83d680 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f39b expref: 10 pid: 5786 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.265568:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113429120 00000100:00100000:2.0:1788916879.265571:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113429120 00010000:00010000:2.0:1788916879.265582:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e0168e200/0x51de7f756a83d687 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3a2 expref: 11 pid: 5787 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.265612:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:2.0:1788916879.265623:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f367f55b-9b55-442e-a009-d3d404e176a2+11:2373:x1875815113428992:12345-192.168.202.40@tcp:103: 00010000:00010000:2.0:1788916879.265642:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916879.265648:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e06ee3e00/0x51de7f756a83d680 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f39b expref: 11 pid: 5786 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.265660:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e06ee3e00/0x51de7f756a83d680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f39b expref: 11 pid: 5786 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.265697:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e06ee3e00/0x51de7f756a83d680 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f39b expref: 11 pid: 5786 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.265716:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788916879.265777:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f367f55b-9b55-442e-a009-d3d404e176a2+10:2373:x1875815113428992:12345-192.168.202.40@tcp:103: Request processed in 155us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916879.265785:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:2.0:1788916879.265814:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:2.0:1788916879.265821:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f367f55b-9b55-442e-a009-d3d404e176a2+9:2373:x1875815113429120:12345-192.168.202.40@tcp:103: 00010000:00010000:2.0:1788916879.265829:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916879.265834:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e0168e200/0x51de7f756a83d687 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3a2 expref: 9 pid: 5787 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.265843:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e0168e200/0x51de7f756a83d687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3a2 expref: 9 pid: 5787 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.265854:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0168e200/0x51de7f756a83d687 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3a2 expref: 9 pid: 5787 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.265867:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d6bf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.265876:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d6bf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.265891:0:6606:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d6bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.265898:0:6606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d6bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.265912:0:6606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d6bf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.265920:0:6606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d6bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.265926:0:6606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fd800 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788916879.265930:0:6606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d6bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.265939:0:6606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d6bf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.265950:0:6606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d6bf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916879.265960:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788916879.265979:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f367f55b-9b55-442e-a009-d3d404e176a2+8:2373:x1875815113429120:12345-192.168.202.40@tcp:103: Request processed in 159us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916879.265986:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00010000:00010000:0.0:1788916879.266749:0:8307:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d6bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916879.266760:0:8307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d6bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916879.266766:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e013fd800/0x51de7f756a83d6bf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916879.752941:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916879.752989:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916879.753081:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916879.753182:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113429248 00000100:00100000:0.0:1788916879.753193:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113429248 00000100:00100000:0.0:1788916879.753265:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:0.0:1788916879.753276:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2371:x1875815113429248:12345-192.168.202.40@tcp:400: 00000100:00100000:0.0:1788916879.753365:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2371:x1875815113429248:12345-192.168.202.40@tcp:400: Request processed in 91us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916879.753372:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00080000:3.0:1788916879.755123:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788916879.764641:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113429504 00000100:00100000:3.0:1788916879.764642:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113429376 00000100:00100000:3.0:1788916879.764661:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113429376 00000100:00100000:1.0:1788916879.764714:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113429504 00000100:00100000:3.0:1788916879.764782:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:3.0:1788916879.764795:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2371:x1875815113429376:12345-192.168.202.40@tcp:400: 00000100:00080000:2.0:1788916879.764887:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788916879.765448:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37278380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2371:x1875815113429376:12345-192.168.202.40@tcp:400: Request processed in 652us (12362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916879.765459:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:0.0:1788916879.766715:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:0.0:1788916879.766728:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2371:x1875815113429504:12345-192.168.202.40@tcp:400: 00000100:00100000:0.0:1788916879.766805:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2371:x1875815113429504:12345-192.168.202.40@tcp:400: Request processed in 79us (13814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916879.766812:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00080000:3.0:1788916879.767165:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788916880.159393:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788916881.056212:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788916881.056222:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a6e3f439800 from 39 10000000:01000000:1.0:1788916881.056228:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788916881.056289:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83d6c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916881.056302:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83d6c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916881.056313:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83d6c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916881.056343:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140717312:0@lo:101: 00000100:00100000:1.0:1788916881.056434:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916881.056663:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e37e38840 going to sleep for 11 seconds 00000100:00100000:2.0:1788916881.063063:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140717312 00000100:00100000:2.0:1788916881.063083:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140717312 00000100:00100000:2.0:1788916881.063362:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788916881.063375:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+12:5789:x1875815140717312:12345-0@lo:101: 00010000:00010000:2.0:1788916881.063650:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916881.063709:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e013fde00/0x51de7f756a83d6cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d6c6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916881.063753:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e013fde00/0x51de7f756a83d6cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d6c6 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916881.063768:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e013fde00/0x51de7f756a83d6cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d6c6 expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916881.063779:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e013fde00, rc 0) 00000100:00100000:2.0:1788916881.064286:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+13:5789:x1875815140717312:12345-0@lo:101: Request processed in 913us (7850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916881.064296:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788916881.064556:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140717312:0@lo:101: 00010000:00010000:1.0:1788916881.064583:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83d6c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d6cd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916881.064596:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83d6c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d6cd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916881.065276:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140717440:0@lo:501: 00000100:00100000:1.0:1788916881.065339:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916881.065392:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e37e38840 going to sleep for 11 seconds 00000100:00100000:0.0:1788916881.065489:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140717440 00000100:00100000:0.0:1788916881.065497:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140717440 00000100:00100000:0.0:1788916881.065563:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788916881.065588:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:5789:x1875815140717440:12345-0@lo:501: 00000100:00100000:0.0:1788916881.066093:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:5789:x1875815140717440:12345-0@lo:501: Request processed in 505us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916881.066101:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788916881.066268:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140717440:0@lo:501: 00000100:00100000:1.0:1788916881.066316:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140717568:0@lo:503: 00000100:00100000:1.0:1788916881.066363:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916881.066557:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140717568 00000100:00100000:3.0:1788916881.066563:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140717568 00000100:00100000:3.0:1788916881.066607:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788916881.066622:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+13:5789:x1875815140717568:12345-0@lo:503: 00000100:00100000:3.0:1788916881.066801:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+13:5789:x1875815140717568:12345-0@lo:503: Request processed in 181us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916881.066809:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788916881.074282:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e37e38840 going to sleep for 11 seconds 00000100:00100000:1.0:1788916881.074338:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140717568:0@lo:503: 00000100:00100000:1.0:1788916881.075134:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8323:1875815140717696:0@lo:502: 00000100:00100000:1.0:1788916881.075323:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916881.075428:0:8323:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e37e380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788916881.079837:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140717696 00000100:00100000:3.0:1788916881.079930:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140717696 00000100:00100000:3.0:1788916881.080085:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788916881.080098:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+13:8323:x1875815140717696:12345-0@lo:502: 00000100:00100000:3.0:1788916881.080520:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+13:8323:x1875815140717696:12345-0@lo:502: Request processed in 424us (5197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916881.080529:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788916881.080698:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8323:1875815140717696:0@lo:502: 00000100:00100000:1.0:1788916881.080794:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8323:1875815140717824:0@lo:502: 00000100:00100000:1.0:1788916881.080858:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916881.089361:0:8323:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e37e380c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916881.096299:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140717824 00000100:00100000:0.0:1788916881.096325:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140717824 00000100:00100000:0.0:1788916881.096413:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788916881.096424:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:8323:x1875815140717824:12345-0@lo:502: 00000100:00100000:0.0:1788916881.097294:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:8323:x1875815140717824:12345-0@lo:502: Request processed in 867us (16443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916881.097306:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788916881.101801:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8323:1875815140717824:0@lo:502: 00000040:00080000:1.0:1788916881.102015:0:8323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788916881.102316:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788916881.102343:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788916881.102356:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83d6c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d6cd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916881.102368:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83d6c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d6cd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788916881.102378:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788916881.102381:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788916881.102384:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788916881.102428:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f200/0x51de7f756a83d6d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916881.102436:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f200/0x51de7f756a83d6d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916881.102446:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f200/0x51de7f756a83d6d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916881.102482:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140717952:0@lo:101: 00000100:00100000:3.0:1788916881.102564:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916881.102614:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e054f6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788916881.102794:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140717952 00000100:00100000:1.0:1788916881.102801:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140717952 00000100:00100000:1.0:1788916881.103001:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788916881.103012:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+13:5789:x1875815140717952:12345-0@lo:101: 00010000:00010000:1.0:1788916881.103029:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916881.103046:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e1eeaa800/0x51de7f756a83d6db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d6d4 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916881.103071:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e1eeaa800/0x51de7f756a83d6db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d6d4 expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916881.103081:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e1eeaa800/0x51de7f756a83d6db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d6d4 expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916881.103101:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeaa800, rc 0) 00000100:00100000:1.0:1788916881.103229:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+14:5789:x1875815140717952:12345-0@lo:101: Request processed in 219us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916881.103237:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788916881.112813:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140717952:0@lo:101: 00010000:00010000:0.0:1788916881.112959:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f200/0x51de7f756a83d6d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d6db expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916881.112974:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f200/0x51de7f756a83d6d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d6db expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916881.113079:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140718080:0@lo:501: 00000100:00100000:0.0:1788916881.113237:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916881.113371:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3a244480 going to sleep for 11 seconds 00000100:00100000:2.0:1788916881.123020:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140718080 00000100:00100000:2.0:1788916881.123038:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140718080 00000100:00100000:2.0:1788916881.124197:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788916881.124219:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+14:5789:x1875815140718080:12345-0@lo:501: 00000100:00100000:2.0:1788916881.124657:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+14:5789:x1875815140718080:12345-0@lo:501: Request processed in 447us (11508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916881.124665:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788916881.124806:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140718080:0@lo:501: 00000100:00100000:0.0:1788916881.124881:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140718208:0@lo:503: 00000100:00100000:0.0:1788916881.124937:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916881.127127:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3a244480 going to sleep for 11 seconds 00000100:00100000:3.0:1788916881.134899:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140718208 00000100:00100000:3.0:1788916881.134920:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140718208 00000100:00100000:3.0:1788916881.135008:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788916881.135021:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+14:5789:x1875815140718208:12345-0@lo:503: 00000100:00100000:3.0:1788916881.136265:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+14:5789:x1875815140718208:12345-0@lo:503: Request processed in 1241us (11321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916881.136279:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788916881.139831:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140718208:0@lo:503: 00000100:00100000:3.0:1788916881.146429:0:8324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8324:1875815140718336:0@lo:502: 00000100:00100000:3.0:1788916881.146559:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916881.146670:0:8324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e054f6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788916881.151490:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140718336 00000100:00100000:2.0:1788916881.151511:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140718336 00000100:00100000:2.0:1788916881.151611:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788916881.151625:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+14:8324:x1875815140718336:12345-0@lo:502: 00000100:00100000:2.0:1788916881.152026:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+14:8324:x1875815140718336:12345-0@lo:502: Request processed in 402us (5465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916881.152035:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788916881.153329:0:8324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8324:1875815140718336:0@lo:502: 00000020:01000000:3.0:1788916881.153410:0:8324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788916881.153427:0:8324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788916881.153430:0:8324:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788916881.153437:0:8324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788916881.153485:0:8324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8324:1875815140718464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788916881.153576:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916881.153620:0:8324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e408fe840 going to sleep for 11 seconds 00000100:00100000:1.0:1788916881.153973:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140718464 00000100:00100000:1.0:1788916881.153981:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140718464 00000100:00100000:2.0:1788916881.154707:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788916881.154720:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+14:8324:x1875815140718464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788916881.155013:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+14:8324:x1875815140718464:12345-0@lo:502:llog_process_th.0 Request processed in 296us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916881.155022:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788916881.155092:0:8324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8324:1875815140718464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788916881.155317:0:8324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788916881.155326:0:8324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788916881.155329:0:8324:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788916881.155333:0:8324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788916881.155520:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788916881.155550:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788916881.155564:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f200/0x51de7f756a83d6d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d6db expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916881.155576:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f200/0x51de7f756a83d6d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d6db expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788916881.155587:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788916881.155589:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a6e2c984800 from 39 10000000:01000000:0.0:1788916881.155592:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788916881.155627:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2000/0x51de7f756a83d6e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916881.155636:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2000/0x51de7f756a83d6e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916881.155646:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2000/0x51de7f756a83d6e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916881.155668:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140718592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788916881.155719:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916881.155756:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3a244480 going to sleep for 11 seconds 00000100:00100000:1.0:1788916881.155978:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140718592 00000100:00100000:1.0:1788916881.155984:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140718592 00000100:00100000:1.0:1788916881.156026:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788916881.156035:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b462050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+14:5789:x1875815140718592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788916881.156047:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916881.156061:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e1eeaa200/0x51de7f756a83d6e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d6e2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916881.156084:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e1eeaa200/0x51de7f756a83d6e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d6e2 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916881.156094:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e1eeaa200/0x51de7f756a83d6e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d6e2 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916881.156102:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeaa200, rc 0) 00000100:00100000:1.0:1788916881.156626:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b462050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+15:5789:x1875815140718592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916881.156634:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788916881.158624:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140718592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788916881.158658:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2000/0x51de7f756a83d6e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d6e9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916881.158695:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2000/0x51de7f756a83d6e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d6e9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916881.159336:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140718720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788916881.159461:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916881.159784:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3a244480 going to sleep for 11 seconds 00000100:00100000:3.0:1788916881.160934:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140718720 00000100:00100000:3.0:1788916881.160946:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140718720 00000100:00100000:3.0:1788916881.161012:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788916881.161025:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+15:5789:x1875815140718720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788916881.161446:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+15:5789:x1875815140718720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 423us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916881.161456:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788916881.161719:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140718720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788916881.161775:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140718848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788916881.161835:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916881.161884:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e37e38300 going to sleep for 11 seconds 00000100:00100000:3.0:1788916881.162219:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140718848 00000100:00100000:3.0:1788916881.162226:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140718848 00000100:00100000:3.0:1788916881.162271:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788916881.162279:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+15:5789:x1875815140718848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788916881.162458:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+15:5789:x1875815140718848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916881.162465:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788916881.162656:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140718848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788916881.166544:0:8325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8325:1875815140718976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788916881.166686:0:8325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916881.166745:0:8325:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e1fd0f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788916881.166827:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140718976 00000100:00100000:1.0:1788916881.166838:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140718976 00000100:00100000:1.0:1788916881.166904:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788916881.166916:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+15:8325:x1875815140718976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788916881.167306:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+15:8325:x1875815140718976:12345-0@lo:502:llog_process_th.0 Request processed in 390us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916881.167315:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788916881.167559:0:8325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8325:1875815140718976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788916881.167629:0:8325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8325:1875815140719104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788916881.167673:0:8325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916881.167708:0:8325:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e1fd0f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788916881.168391:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140719104 00000100:00100000:1.0:1788916881.168400:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140719104 00000100:00100000:1.0:1788916881.168452:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788916881.168462:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+15:8325:x1875815140719104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788916881.168719:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+15:8325:x1875815140719104:12345-0@lo:502:llog_process_th.0 Request processed in 258us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916881.168727:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788916881.168819:0:8325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8325:1875815140719104:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788916881.168866:0:8325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788916881.169498:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788916881.169523:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788916881.169545:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2000/0x51de7f756a83d6e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d6e9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916881.169557:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2000/0x51de7f756a83d6e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d6e9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916881.169568:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788916881.169571:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788916881.169585:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788916881.169622:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab800/0x51de7f756a83d6f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916881.169631:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab800/0x51de7f756a83d6f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916881.169642:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab800/0x51de7f756a83d6f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916881.169666:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140719232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788916881.169730:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916881.169770:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e37e383c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788916881.169822:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140719232 00000100:00100000:2.0:1788916881.169830:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140719232 00000100:00100000:2.0:1788916881.169886:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788916881.169894:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+15:5789:x1875815140719232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788916881.169907:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916881.169922:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e013fd000/0x51de7f756a83d6f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d6f0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916881.169949:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e013fd000/0x51de7f756a83d6f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d6f0 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916881.169960:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e013fd000/0x51de7f756a83d6f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d6f0 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916881.169969:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e013fd000, rc 0) 00000100:00100000:2.0:1788916881.170021:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+16:5789:x1875815140719232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916881.170028:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788916881.170196:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140719232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788916881.170213:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab800/0x51de7f756a83d6f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d6f7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916881.170223:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab800/0x51de7f756a83d6f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d6f7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916881.170279:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140719360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788916881.170317:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916881.170344:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e1fd0f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788916881.170596:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140719360 00000100:00100000:1.0:1788916881.170602:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140719360 00000100:00100000:1.0:1788916881.170641:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788916881.170648:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+16:5789:x1875815140719360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788916881.171599:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+16:5789:x1875815140719360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 947us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916881.171614:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788916881.171761:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140719360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788916881.171821:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140719488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788916881.171901:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916881.171938:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3a244b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788916881.172123:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140719488 00000100:00100000:1.0:1788916881.172129:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140719488 00000100:00100000:1.0:1788916881.172259:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788916881.172267:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+16:5789:x1875815140719488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788916881.172655:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+16:5789:x1875815140719488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 388us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916881.172663:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788916881.172899:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140719488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788916881.174728:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8326:1875815140719616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788916881.174818:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916881.174867:0:8326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3a244480 going to sleep for 11 seconds 00000100:00100000:2.0:1788916881.174998:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140719616 00000100:00100000:2.0:1788916881.175013:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140719616 00000100:00100000:2.0:1788916881.175068:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788916881.175079:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+16:8326:x1875815140719616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788916881.175585:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+16:8326:x1875815140719616:12345-0@lo:502:llog_process_th.0 Request processed in 506us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916881.175595:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788916881.175940:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8326:1875815140719616:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788916881.175981:0:8326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788916881.175992:0:8326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788916881.175995:0:8326:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788916881.176000:0:8326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788916881.176031:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8326:1875815140719744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788916881.176079:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916881.176116:0:8326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3a244480 going to sleep for 11 seconds 00000100:00100000:1.0:1788916881.177680:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140719744 00000100:00100000:1.0:1788916881.177718:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140719744 00000100:00100000:1.0:1788916881.177779:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788916881.177792:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+16:8326:x1875815140719744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788916881.178079:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+16:8326:x1875815140719744:12345-0@lo:502:llog_process_th.0 Request processed in 290us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916881.178088:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788916881.178328:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8326:1875815140719744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788916881.178386:0:8326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788916881.178393:0:8326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788916881.178405:0:8326:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788916881.178410:0:8326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1788916881.179643:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788916881.179677:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788916881.179689:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab800/0x51de7f756a83d6f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d6f7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916881.179701:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab800/0x51de7f756a83d6f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d6f7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916881.179713:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788916881.179716:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a6e171d2800 from 39 10000000:01000000:1.0:1788916881.179719:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788916881.179757:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab000/0x51de7f756a83d6fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916881.179765:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab000/0x51de7f756a83d6fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916881.179774:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab000/0x51de7f756a83d6fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916881.179795:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140719872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788916881.179851:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916881.179894:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e054c6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788916881.180015:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140719872 00000100:00100000:2.0:1788916881.180022:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140719872 00000100:00100000:2.0:1788916881.180061:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788916881.180070:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+16:5789:x1875815140719872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788916881.180083:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916881.180098:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e013fd200/0x51de7f756a83d705 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d6fe expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916881.180120:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e013fd200/0x51de7f756a83d705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d6fe expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916881.180130:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e013fd200/0x51de7f756a83d705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d6fe expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916881.180138:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e013fd200, rc 0) 00000100:00100000:2.0:1788916881.180316:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140719872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 247us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916881.180324:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788916881.181135:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140719872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788916881.181170:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab000/0x51de7f756a83d6fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d705 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916881.181181:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab000/0x51de7f756a83d6fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d705 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916881.181247:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140720000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788916881.181286:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916881.181329:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3a244480 going to sleep for 11 seconds 00000100:00100000:3.0:1788916881.181488:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140720000 00000100:00100000:3.0:1788916881.181495:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140720000 00000100:00100000:3.0:1788916881.181566:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788916881.181576:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140720000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788916881.183820:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140720000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2235us (2521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916881.183836:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00010000:00010000:1.0:1788916881.183892:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916881.183966:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140720000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788916881.184025:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140720128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788916881.184101:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916881.184136:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3a244480 going to sleep for 11 seconds 00000100:00100000:1.0:1788916881.184291:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140720128 00000100:00100000:1.0:1788916881.184298:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140720128 00000100:00100000:1.0:1788916881.184346:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788916881.184355:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140720128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788916881.192202:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140720128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5147us (5400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916881.192225:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788916881.192670:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140720128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788916881.194394:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8327:1875815140720256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788916881.194496:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916881.194570:0:8327:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3a244240 going to sleep for 11 seconds 00000100:00100000:3.0:1788916881.194590:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140720256 00000100:00100000:3.0:1788916881.194600:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140720256 00000100:00100000:3.0:1788916881.194660:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788916881.194671:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+17:8327:x1875815140720256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788916881.195273:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+17:8327:x1875815140720256:12345-0@lo:502:llog_process_th.0 Request processed in 602us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916881.195283:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788916881.195406:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8327:1875815140720256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788916881.195472:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8327:1875815140720384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788916881.195630:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916881.195701:0:8327:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3a244240 going to sleep for 11 seconds 00000100:00100000:1.0:1788916881.195978:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140720384 00000100:00100000:1.0:1788916881.195985:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140720384 00000100:00100000:2.0:1788916881.206093:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788916881.206266:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+17:8327:x1875815140720384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788916881.206661:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+17:8327:x1875815140720384:12345-0@lo:502:llog_process_th.0 Request processed in 550us (11029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916881.206672:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788916881.207634:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8327:1875815140720384:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788916881.207697:0:8327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788916881.207810:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788916881.207829:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788916881.207842:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab000/0x51de7f756a83d6fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d705 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916881.207854:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab000/0x51de7f756a83d6fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d705 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788916881.207867:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788916881.207870:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788916881.207874:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788916881.207916:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2600/0x51de7f756a83d70c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916881.207924:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2600/0x51de7f756a83d70c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916881.207935:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2600/0x51de7f756a83d70c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916881.207961:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140720512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788916881.208017:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916881.208121:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3a244540 going to sleep for 11 seconds 00000100:00100000:3.0:1788916881.208801:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140720512 00000100:00100000:3.0:1788916881.208809:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140720512 00000100:00100000:3.0:1788916881.209002:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788916881.209013:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140720512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788916881.209028:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916881.209055:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e0149f400/0x51de7f756a83d713 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d70c expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916881.209082:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0149f400/0x51de7f756a83d713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d70c expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916881.209093:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e0149f400/0x51de7f756a83d713 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d70c expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916881.209100:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0149f400, rc 0) 00000100:00100000:3.0:1788916881.209375:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140720512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 363us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916881.209383:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788916881.209383:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140720512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788916881.209597:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2600/0x51de7f756a83d70c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d713 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916881.209620:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2600/0x51de7f756a83d70c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d713 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916881.209696:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140720640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788916881.209728:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916881.209767:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3a244540 going to sleep for 11 seconds 00000100:00100000:3.0:1788916881.209839:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140720640 00000100:00100000:3.0:1788916881.209844:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140720640 00000100:00100000:3.0:1788916881.209875:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788916881.209883:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140720640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788916881.210694:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140720640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 809us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916881.210704:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788916881.210776:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140720640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788916881.210816:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140720768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788916881.210868:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916881.210939:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3a244540 going to sleep for 11 seconds 00000100:00100000:3.0:1788916881.210971:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140720768 00000100:00100000:3.0:1788916881.210976:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140720768 00000100:00100000:3.0:1788916881.211045:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788916881.211054:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140720768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788916881.211355:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140720768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 302us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916881.211362:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788916881.211442:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140720768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788916881.213028:0:8328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8328:1875815140720896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788916881.213107:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916881.213179:0:8328:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e0a6380c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788916881.213318:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140720896 00000100:00100000:3.0:1788916881.213332:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140720896 00000100:00100000:3.0:1788916881.213413:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788916881.213422:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+18:8328:x1875815140720896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788916881.213680:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+18:8328:x1875815140720896:12345-0@lo:502:llog_process_th.0 Request processed in 258us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916881.213688:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788916881.213774:0:8328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8328:1875815140720896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788916881.213814:0:8328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788916881.213824:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788916881.213827:0:8328:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788916881.213833:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788916881.221569:0:8328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8328:1875815140721024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788916881.221684:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916881.221737:0:8328:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3a244840 going to sleep for 11 seconds 00000100:00100000:3.0:1788916881.222453:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140721024 00000100:00100000:3.0:1788916881.222463:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140721024 00000100:00100000:3.0:1788916881.222527:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788916881.222547:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:8328:x1875815140721024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788916881.222843:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:8328:x1875815140721024:12345-0@lo:502:llog_process_th.0 Request processed in 298us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916881.222851:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788916881.223351:0:8328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a770000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8328:1875815140721024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788916881.223396:0:8328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788916881.223404:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788916881.223413:0:8328:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788916881.223418:0:8328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788916881.224564:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788916881.224593:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788916881.224607:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2600/0x51de7f756a83d70c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d713 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916881.224621:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2600/0x51de7f756a83d70c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d713 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788916881.224631:0:5789:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788916881.224634:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a6e0a73b380 from 1 10000000:01000000:0.0:1788916881.224636:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788916881.224675:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2400/0x51de7f756a83d71a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916881.224698:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2400/0x51de7f756a83d71a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916881.224708:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2400/0x51de7f756a83d71a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916881.224733:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140721152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788916881.224813:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916881.224889:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3a2443c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788916881.225348:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140721152 00000100:00100000:3.0:1788916881.225374:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140721152 00000100:00100000:3.0:1788916881.225464:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788916881.225485:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140721152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788916881.225501:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916881.226933:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e0149e600/0x51de7f756a83d721 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d71a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916881.226974:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0149e600/0x51de7f756a83d721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d71a expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916881.226985:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e0149e600/0x51de7f756a83d721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d71a expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916881.226994:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0149e600, rc 0) 00000100:00100000:3.0:1788916881.227089:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140721152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1616us (2275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916881.227098:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788916881.227521:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140721152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788916881.227551:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2400/0x51de7f756a83d71a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d721 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916881.227562:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2400/0x51de7f756a83d71a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d721 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916881.227648:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140721280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788916881.227685:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916881.227730:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3a2443c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788916881.228093:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140721280 00000100:00100000:3.0:1788916881.228110:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140721280 00000100:00100000:3.0:1788916881.228226:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788916881.228236:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140721280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788916881.228672:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140721280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 436us (984us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788916881.228681:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788916881.228773:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140721280:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788916881.228808:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788916881.228816:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2400/0x51de7f756a83d71a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d721 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916881.228839:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2400/0x51de7f756a83d71a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d721 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916881.951824:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140721408:0@lo:400:kworker.0 00000100:00100000:1.0:1788916881.951911:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916881.951983:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140721408 00000100:00100000:0.0:1788916881.951992:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140721408 00000100:00100000:0.0:1788916881.952069:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788916881.952081:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140721408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916881.952190:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140721536:0@lo:400:kworker.0 00000100:00100000:2.0:1788916881.952224:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916881.952255:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788916881.952271:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140721664:0@lo:400:kworker.0 00000100:00100000:2.0:1788916881.952310:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916881.952345:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140721792:0@lo:400:kworker.0 00000100:00100000:2.0:1788916881.952371:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916881.952401:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140721536 00000100:00100000:2.0:1788916881.952405:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140721536 00000100:00100000:2.0:1788916881.952436:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140721792 00000100:00100000:2.0:1788916881.952439:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140721792 00000100:00100000:2.0:1788916881.952457:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788916881.952463:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140721536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916881.952503:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140721536:12345-0@lo:400:kworker.0 Request processed in 39us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916881.952522:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788916881.952548:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788916881.952555:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3727aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140721792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916881.952586:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3727aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140721792:12345-0@lo:400:kworker.0 Request processed in 31us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916881.952592:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788916881.952611:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140721664 00000100:00100000:2.0:1788916881.952614:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140721664 00000100:00100000:2.0:1788916881.952642:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788916881.952650:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3727a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140721664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916881.952701:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3727a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140721664:12345-0@lo:400:kworker.0 Request processed in 52us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916881.952707:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788916881.952751:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140721792:0@lo:400:kworker.0 00010000:00080000:2.0:1788916881.952784:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e1edf2d80 x1875815140721664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916881.952795:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140721664:0@lo:400:kworker.0 00000100:00100000:2.0:1788916881.952804:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140721536:0@lo:400:kworker.0 00000100:00080000:2.0:1788916881.952827:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788916881.952832:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788916881.953613:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788916881.953626:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140721920:0@lo:400:kworker.0 00000100:00100000:2.0:1788916881.953674:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916881.953808:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140721920 00000100:00100000:3.0:1788916881.953815:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140721920 00000100:00100000:3.0:1788916881.953866:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788916881.953875:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140721920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916881.953923:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140721920:12345-0@lo:400:kworker.0 Request processed in 49us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916881.953929:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788916881.953975:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e1edf2a00 x1875815140721920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916881.953986:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140721920:0@lo:400:kworker.0 00000100:00080000:2.0:1788916881.954168:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788916881.955125:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140721408:0@lo:400:kworker.0 00000100:00100000:0.0:1788916881.955386:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140721408:12345-0@lo:400:kworker.0 Request processed in 3041us (3208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916881.955400:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1788916882.207699:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916882.463616:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788916882.463646:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140722048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788916882.463721:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916882.463854:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140722048 00000100:00100000:0.0:1788916882.463862:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140722048 00000100:00100000:0.0:1788916882.463913:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788916882.463928:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140722048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788916882.463980:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788916882.464039:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140722048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916882.464048:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788916882.464239:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e28d61500 x1875815140722048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916882.464259:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140722048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788916882.975427:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788916882.975454:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140722176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788916882.975562:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916882.975770:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140722176 00000100:00100000:0.0:1788916882.975780:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140722176 00000100:00100000:0.0:1788916882.975844:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788916882.975854:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140722176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788916882.975897:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788916882.975963:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140722176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916882.975971:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788916882.976096:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e3a17df80 x1875815140722176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916882.976126:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140722176:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788916883.231534:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916884.255411:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916884.882808:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916884.882958:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916884.883016:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916884.883068:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916884.883114:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113429888 00000100:00100000:2.0:1788916884.883129:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113429888 00000100:00100000:2.0:1788916884.883232:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113430016 00000100:00100000:2.0:1788916884.883235:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113430016 00000100:00100000:2.0:1788916884.883271:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:2.0:1788916884.883280:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2373:x1875815113429888:12345-192.168.202.40@tcp:400: 00000100:00100000:2.0:1788916884.883355:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2373:x1875815113429888:12345-192.168.202.40@tcp:400: Request processed in 77us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916884.883361:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:2.0:1788916884.883388:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:2.0:1788916884.883393:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2373:x1875815113430016:12345-192.168.202.40@tcp:400: 00000100:00100000:2.0:1788916884.883413:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2373:x1875815113430016:12345-192.168.202.40@tcp:400: Request processed in 21us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916884.883419:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00080000:2.0:1788916884.883433:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788916884.883436:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788916884.883521:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113429760 00000100:00100000:1.0:1788916884.883526:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113429760 00000100:00100000:1.0:1788916884.883578:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:1.0:1788916884.883587:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2373:x1875815113429760:12345-192.168.202.40@tcp:400: 00000100:00100000:1.0:1788916884.883640:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2373:x1875815113429760:12345-192.168.202.40@tcp:400: Request processed in 55us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916884.883646:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00080000:1.0:1788916884.883663:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788916884.887433:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113429632 00000100:00100000:3.0:1788916884.887453:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113429632 00000100:00100000:3.0:1788916884.887535:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 166 00000100:00100000:3.0:1788916884.887546:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+8:2373:x1875815113429632:12345-192.168.202.40@tcp:400: 00000100:00100000:3.0:1788916884.887645:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+8:2373:x1875815113429632:12345-192.168.202.40@tcp:400: Request processed in 102us (4851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916884.887652:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 166 00010000:00010000:1.0:1788916885.279862:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916885.387541:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916885.388547:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113430144 00000100:00100000:3.0:1788916885.388559:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113430144 00000100:00100000:3.0:1788916885.388628:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 167 00000100:00100000:3.0:1788916885.388639:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+8:5593:x1875815113430144:12345-192.168.202.40@tcp:101: 00010000:00010000:3.0:1788916885.388658:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916885.388678:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d728 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f404 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916885.388710:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f404 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916885.388723:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f404 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916885.388732:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0149f600, rc 0) 00000100:00100000:3.0:1788916885.388800:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+9:5593:x1875815113430144:12345-192.168.202.40@tcp:101: Request processed in 162us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916885.388815:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 167 00000100:00100000:2.0:1788916885.395118:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916885.395261:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113430272 00000100:00100000:0.0:1788916885.395272:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113430272 00000100:00100000:0.0:1788916885.395342:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 168 00000100:00100000:0.0:1788916885.395353:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+9:5593:x1875815113430272:12345-192.168.202.40@tcp:501: 00000100:00100000:0.0:1788916885.395717:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+9:5593:x1875815113430272:12345-192.168.202.40@tcp:501: Request processed in 366us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916885.395727:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 168 00000100:00100000:2.0:1788916885.398827:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916885.399125:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113430400 00000100:00100000:0.0:1788916885.399135:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113430400 00000100:00100000:0.0:1788916885.399224:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 169 00000100:00100000:0.0:1788916885.399235:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+9:5593:x1875815113430400:12345-192.168.202.40@tcp:503: 00000100:00100000:0.0:1788916885.399702:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+9:5593:x1875815113430400:12345-192.168.202.40@tcp:503: Request processed in 468us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916885.399711:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 169 00000100:00100000:2.0:1788916885.412655:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916885.413082:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113430528 00000100:00100000:3.0:1788916885.413100:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113430528 00000100:00100000:3.0:1788916885.413463:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 170 00000100:00100000:3.0:1788916885.413476:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+9:6091:x1875815113430528:12345-192.168.202.40@tcp:502: 00000100:00100000:3.0:1788916885.413950:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+9:6091:x1875815113430528:12345-192.168.202.40@tcp:502: Request processed in 476us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916885.413959:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 170 00000100:00100000:2.0:1788916885.434264:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916885.434506:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113430656 00000100:00100000:0.0:1788916885.434518:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113430656 00000100:00100000:0.0:1788916885.434592:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 171 00000100:00100000:0.0:1788916885.434603:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+9:6091:x1875815113430656:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788916885.446376:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+9:6091:x1875815113430656:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 11755us (12104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916885.446398:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 171 00000100:00100000:2.0:1788916885.453420:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916885.453827:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113430784 00000100:00100000:3.0:1788916885.453851:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113430784 00000100:00100000:3.0:1788916885.453941:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 172 00000100:00100000:3.0:1788916885.453954:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+9:5593:x1875815113430784:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788916885.453978:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916885.454000:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d72f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f40b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916885.454040:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d72f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f40b expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916885.454054:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d72f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f40b expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916885.454073:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0149e200, rc 0) 00000100:00100000:3.0:1788916885.454203:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+10:5593:x1875815113430784:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 251us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916885.454211:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 172 00000100:00100000:2.0:1788916885.463439:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916885.463563:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113430912 00000100:00100000:1.0:1788916885.463586:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113430912 00000100:00100000:1.0:1788916885.463650:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 173 00000100:00100000:1.0:1788916885.463660:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+10:5593:x1875815113430912:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788916885.463991:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+10:5593:x1875815113430912:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 331us (860us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788916885.464000:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 173 00010000:00010000:1.0:1788916886.304223:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916887.073448:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140722432:0@lo:400:kworker.0 00000100:00100000:2.0:1788916887.073559:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916887.073617:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140722944:0@lo:400:kworker.0 00000100:00100000:2.0:1788916887.073645:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916887.073678:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788916887.073684:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4933373a-b540-4420-bf34-9071e19d7373:3307:1875815140722304:0@lo:400:kworker.0 00000100:00100000:2.0:1788916887.073718:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916887.073753:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140722816:0@lo:400:kworker.0 00000100:00100000:2.0:1788916887.073777:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916887.073896:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140722560:0@lo:400:kworker.0 00000100:00100000:2.0:1788916887.073924:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916887.073944:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788916887.073949:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140722688:0@lo:400:kworker.0 00000100:00100000:2.0:1788916887.073973:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916887.074003:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140722432 00000100:00100000:2.0:1788916887.074011:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140722432 00000100:00100000:2.0:1788916887.074056:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140722816 00000100:00100000:2.0:1788916887.074060:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140722816 00000100:00100000:2.0:1788916887.074084:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140722560 00000100:00100000:2.0:1788916887.074087:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140722560 00000100:00100000:2.0:1788916887.074104:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788916887.074113:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140722432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916887.074195:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140722432:12345-0@lo:400:kworker.0 Request processed in 83us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916887.074203:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788916887.074221:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788916887.074228:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140722816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916887.074255:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140722816:12345-0@lo:400:kworker.0 Request processed in 29us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916887.074262:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788916887.074273:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788916887.074279:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140722560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916887.074309:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140722560:12345-0@lo:400:kworker.0 Request processed in 30us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916887.074327:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788916887.074346:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140722944 00000100:00100000:2.0:1788916887.074351:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140722944 00000100:00100000:2.0:1788916887.074376:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140722688 00000100:00100000:2.0:1788916887.074379:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140722688 00000100:00100000:2.0:1788916887.074398:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788916887.074404:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140722944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916887.074438:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140722944:12345-0@lo:400:kworker.0 Request processed in 34us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916887.074444:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788916887.074455:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788916887.074460:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140722688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916887.074500:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140722688:12345-0@lo:400:kworker.0 Request processed in 39us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916887.074507:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788916887.074538:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788916887.074542:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788916887.074544:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788916887.074574:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e36db2d80 x1875815140722688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916887.074588:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140722688:0@lo:400:kworker.0 00000100:00100000:2.0:1788916887.074602:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140722560:0@lo:400:kworker.0 00000100:00100000:2.0:1788916887.074637:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140722816:0@lo:400:kworker.0 00000100:00100000:2.0:1788916887.074648:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140722432:0@lo:400:kworker.0 00010000:00080000:2.0:1788916887.074658:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e36db1180 x1875815140722944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916887.074679:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140722944:0@lo:400:kworker.0 00000100:00100000:0.0:1788916887.076493:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140722304 00000100:00100000:0.0:1788916887.076508:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140722304 00000100:00100000:0.0:1788916887.076572:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788916887.076583:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3307:x1875815140722304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916887.076681:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3307:x1875815140722304:12345-0@lo:400:kworker.0 Request processed in 101us (2961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916887.076689:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788916887.078530:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4933373a-b540-4420-bf34-9071e19d7373:3307:1875815140722304:0@lo:400:kworker.0 00000020:00000080:1.0:1788916887.087762:0:8367:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce1481950 20000000:00000080:1.0:1788916887.087791:0:8367:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6e3fe5bc00 uarg=0000000000000000 20000000:01000000:1.0:1788916887.087840:0:8367:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788916887.087847:0:8367:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788916887.087853:0:8367:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788916887.091848:0:8368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788916887.094581:0:8367:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788916887.109331:0:8367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788916887.109393:0:8367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788916887.109449:0:8367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788916887.109518:0:8367:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788916887.109545:0:8367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d736 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916887.109566:0:8367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e0149e800/0x51de7f756a83d4ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d4a4 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916887.109573:0:8367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e0168f600/0x51de7f756a83d50d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d506 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916887.109581:0:8367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e0168f200/0x51de7f756a83d5d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d5d1 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916887.109592:0:8367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e06ee2a00/0x51de7f756a83d695 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3d3 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916887.109599:0:8367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d736 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916887.109644:0:8367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e06ee2a00/0x51de7f756a83d695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3d3 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916887.109663:0:8367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6e06ee2a00/0x51de7f756a83d695 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3d3 expref: 9 pid: 5784 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916887.109681:0:8367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1875815140723072:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788916887.109962:0:8367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e0168f200/0x51de7f756a83d5d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d5d1 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916887.109972:0:8367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e0168f200/0x51de7f756a83d5d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d5d1 expref: 18 pid: 5784 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916887.110088:0:8367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1875815140723200:0@lo:104: 00000100:00100000:2.0:1788916887.110134:0:8367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916887.110435:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140723200 00000100:00100000:1.0:1788916887.110445:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140723200 00000100:00100000:1.0:1788916887.110512:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788916887.110528:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+3:8367:x1875815140723200:12345-0@lo:104: 00010000:00010000:1.0:1788916887.110540:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e0168ee00/0x51de7f756a83d5d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d5d8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.110594:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788916887.110601:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+3:8367:x1875815140723200:12345-0@lo:104: Request processed in 80us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916887.110609:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1788916887.110652:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788916887.110662:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e0168ee00/0x51de7f756a83d5d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d5d8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916887.110671:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168ee00 already unused, calling callback (ffffffffc1d46c20) 00010000:00010000:2.0:1788916887.110672:0:8367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e0168f600/0x51de7f756a83d50d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d506 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788916887.110679:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0168ee00/0x51de7f756a83d5d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d5d8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916887.110682:0:8367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e0168f600/0x51de7f756a83d50d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d506 expref: 18 pid: 5787 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916887.110702:0:8367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1875815140723328:0@lo:104: 00010000:00010000:0.0:1788916887.110703:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e0168ee00/0x51de7f756a83d5d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d5d8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788916887.110715:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0168ee00/0x51de7f756a83d5d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d5d8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916887.110726:0:8367:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788916887.110738:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788916887.110750:0:8367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e0149e800/0x51de7f756a83d4ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d4a4 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916887.110757:0:8367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e0149e800/0x51de7f756a83d4ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d4a4 expref: 18 pid: 5784 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916887.110763:0:8367:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1875815140723456:0@lo:104: 00000100:00100000:2.0:1788916887.110778:0:8367:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3728de40 going to sleep for 11 seconds 00010000:00010000:0.0:1788916887.110781:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e0168ee00/0x51de7f756a83d5d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d5d8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916887.110790:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788916887.110815:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e0168ee00/0x51de7f756a83d5d1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d5d8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916887.110823:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e0168ee00/0x51de7f756a83d5d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d5d8 expref: -99 pid: 7487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916887.110837:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916887.110839:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916887.110840:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916887.110856:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140723584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788916887.110890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916887.110949:0:8367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1875815140723200:0@lo:104: 00000100:00100000:3.0:1788916887.110980:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788916887.111004:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916887.111035:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140723328 00000100:00100000:3.0:1788916887.111040:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140723328 00000100:00100000:1.0:1788916887.111061:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140723584 00000100:00100000:3.0:1788916887.111064:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140723456 00000100:00100000:1.0:1788916887.111066:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140723584 00000100:00100000:3.0:1788916887.111071:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140723456 00010000:00010000:1.0:1788916887.111094:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e0168f200/0x51de7f756a83d5d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d5d1 expref: 19 pid: 5784 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916887.111130:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788916887.111135:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140723584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788916887.111164:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916887.111170:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e0168f200/0x51de7f756a83d5d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d5d1 expref: 19 pid: 5784 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.111177:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e0168f200/0x51de7f756a83d5d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d5d1 expref: 19 pid: 5784 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916887.111195:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788916887.111205:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f424450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+4:8367:x1875815140723328:12345-0@lo:104: 00010000:00010000:0.0:1788916887.111215:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc200/0x51de7f756a83d506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d50d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916887.111257:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788916887.111263:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f424450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+4:8367:x1875815140723328:12345-0@lo:104: Request processed in 61us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916887.111271:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788916887.111278:0:8367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1875815140723328:0@lo:104: 00010000:00010000:1.0:1788916887.111311:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0168f200/0x51de7f756a83d5d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d5d1 expref: 19 pid: 5784 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.111326:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916887.111353:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+18:3304:x1875815140723584:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916887.111358:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788916887.111371:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140723584:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788916887.111421:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788916887.111425:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc200/0x51de7f756a83d506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d50d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.111430:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fc200 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1788916887.111433:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc200/0x51de7f756a83d506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d50d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.111438:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc200/0x51de7f756a83d506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d50d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788916887.111442:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc200/0x51de7f756a83d506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d50d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916887.111452:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788916887.111474:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc200/0x51de7f756a83d506 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d50d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.111637:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788916887.111682:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788916887.111736:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc200/0x51de7f756a83d506 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d50d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.111743:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc200/0x51de7f756a83d506 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d50d expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916887.111749:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788916887.111753:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916887.111756:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916887.111757:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916887.111761:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+3:8367:x1875815140723456:12345-0@lo:104: 00010000:00010000:3.0:1788916887.111772:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e0168e800/0x51de7f756a83d4a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d4ab expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916887.111840:0:8367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1875815140723456:0@lo:104: 00010000:00010000:3.0:1788916887.111842:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788916887.111850:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+3:8367:x1875815140723456:12345-0@lo:104: Request processed in 93us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916887.111858:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788916887.111875:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788916887.111879:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e0168e800/0x51de7f756a83d4a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d4ab expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.111884:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168e800 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1788916887.111887:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0168e800/0x51de7f756a83d4a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d4ab expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.111892:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e0168e800/0x51de7f756a83d4a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d4ab expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788916887.111896:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0168e800/0x51de7f756a83d4a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d4ab expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916887.111899:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788916887.111926:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e0168e800/0x51de7f756a83d4a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d4ab expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.111930:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788916887.111947:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e0168e800/0x51de7f756a83d4a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d4ab expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.111951:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e0168e800/0x51de7f756a83d4a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d4ab expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.111962:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916887.111963:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916887.111964:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916887.112037:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140723840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788916887.112069:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916887.112137:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140723840 00000100:00100000:1.0:1788916887.112142:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140723840 00010000:00010000:1.0:1788916887.112193:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e0149e800/0x51de7f756a83d4ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d4a4 expref: 18 pid: 5784 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916887.112212:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788916887.112216:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4933373a-b540-4420-bf34-9071e19d7373+18:3306:x1875815140723840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788916887.112223:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916887.112226:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e0149e800/0x51de7f756a83d4ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d4a4 expref: 18 pid: 5784 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.112232:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e0149e800/0x51de7f756a83d4ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d4a4 expref: 18 pid: 5784 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.112241:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0149e800/0x51de7f756a83d4ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d4a4 expref: 18 pid: 5784 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.112250:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916887.112279:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4933373a-b540-4420-bf34-9071e19d7373+17:3306:x1875815140723840:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916887.112283:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788916887.112302:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140723840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788916887.112541:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140723712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788916887.112564:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916887.112626:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140723712 00000100:00100000:1.0:1788916887.112631:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140723712 00010000:00010000:1.0:1788916887.112647:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e0168f600/0x51de7f756a83d50d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d506 expref: 17 pid: 5787 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916887.112701:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788916887.112708:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+17:3304:x1875815140723712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788916887.112716:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916887.112720:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e0168f600/0x51de7f756a83d50d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d506 expref: 17 pid: 5787 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.112728:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e0168f600/0x51de7f756a83d50d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d506 expref: 17 pid: 5787 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.112738:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0168f600/0x51de7f756a83d50d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d506 expref: 17 pid: 5787 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.112748:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916887.112784:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+16:3304:x1875815140723712:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916887.112790:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788916887.112845:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140723712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788916887.126724:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916887.126956:0:8367:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8367:1875815140723072:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788916887.127004:0:8367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d736 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916887.130380:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113431040 00000100:00100000:3.0:1788916887.130400:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113431040 00010000:00010000:3.0:1788916887.130455:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e06ee2a00/0x51de7f756a83d695 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3d3 expref: 10 pid: 5784 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916887.130532:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:3.0:1788916887.130544:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f367f55b-9b55-442e-a009-d3d404e176a2+10:2373:x1875815113431040:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788916887.130561:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916887.130569:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e06ee2a00/0x51de7f756a83d695 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3d3 expref: 10 pid: 5784 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916887.130583:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e06ee2a00/0x51de7f756a83d695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3d3 expref: 10 pid: 5784 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916887.130623:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e06ee2a00/0x51de7f756a83d695 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3d3 expref: 10 pid: 5784 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916887.130642:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d736 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916887.130650:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d736 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916887.130669:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d736 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916887.130676:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d736 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916887.130682:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d736 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916887.130690:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d736 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916887.130696:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fcc00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788916887.130700:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d736 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916887.130707:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d736 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916887.130732:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d736 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916887.130754:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916887.130818:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f367f55b-9b55-442e-a009-d3d404e176a2+9:2373:x1875815113431040:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 276us (4107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916887.130826:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00010000:00010000:1.0:1788916887.131769:0:8367:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d736 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.131782:0:8367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d736 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.131799:0:8367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d736 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916887.327369:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916887.584605:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788916887.584851:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140723968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788916887.584949:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916887.585047:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140723968 00000100:00100000:0.0:1788916887.585058:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140723968 00000100:00100000:0.0:1788916887.585142:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788916887.585177:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140723968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788916887.585227:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788916887.585279:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140723968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916887.585287:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788916887.585970:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e28d62d80 x1875815140723968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916887.586010:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140723968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788916888.105986:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788916888.122027:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140724096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788916888.122121:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916888.122226:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140724096 00000100:00100000:0.0:1788916888.122237:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140724096 00000100:00100000:0.0:1788916888.122301:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788916888.122312:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140724096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788916888.122372:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788916888.122419:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140724096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916888.122426:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788916888.122483:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2d0b1f80 x1875815140724096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916888.122507:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140724096:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788916888.352018:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916888.402177:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916888.402229:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113431168 00000100:00100000:0.0:1788916888.402249:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113431168 00000100:00100000:0.0:1788916888.402310:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 175 00000100:00100000:0.0:1788916888.402321:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+9:5593:x1875815113431168:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788916888.402347:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916888.402375:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d73d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f412 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916888.402415:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d73d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f412 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916888.402429:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d73d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f412 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916888.402440:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3400, rc 0) 00000100:00100000:0.0:1788916888.402537:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+10:5593:x1875815113431168:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 218us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916888.402545:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 175 00000100:00100000:0.0:1788916888.411239:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916888.411650:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113431296 00000100:00100000:2.0:1788916888.411665:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113431296 00000100:00100000:2.0:1788916888.411745:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 176 00000100:00100000:2.0:1788916888.411757:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+10:5593:x1875815113431296:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788916888.412178:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+10:5593:x1875815113431296:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 422us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916888.412186:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 176 00000100:00100000:3.0:1788916888.417298:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916888.417461:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113431424 00000100:00100000:0.0:1788916888.417485:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113431424 00000100:00100000:0.0:1788916888.417565:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 177 00000100:00100000:0.0:1788916888.417578:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0325c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+10:5593:x1875815113431424:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788916888.417848:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0325c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+10:5593:x1875815113431424:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 272us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916888.417857:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 177 00000100:00100000:0.0:1788916888.424034:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916888.424427:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113431552 00000100:00100000:3.0:1788916888.424444:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113431552 00000100:00100000:3.0:1788916888.424568:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 178 00000100:00100000:3.0:1788916888.424582:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0325e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+10:6148:x1875815113431552:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788916888.424929:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0325e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+10:6148:x1875815113431552:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 348us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916888.424939:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 178 00000100:00100000:0.0:1788916888.440575:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916888.440680:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113431680 00000100:00100000:1.0:1788916888.440694:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113431680 00000100:00100000:1.0:1788916888.440764:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 179 00000100:00100000:1.0:1788916888.440777:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0dd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+10:6148:x1875815113431680:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788916888.441107:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0dd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+10:6148:x1875815113431680:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 330us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916888.441117:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 179 10000000:01000000:1.0:1788916888.868690:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788916888.868701:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e3f439800 from 4 10000000:01000000:1.0:1788916888.868708:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788916888.868784:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaae00/0x51de7f756a83d744 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.868799:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaae00/0x51de7f756a83d744 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.868813:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaae00/0x51de7f756a83d744 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916888.868848:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140724224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.868957:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916888.869039:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788916888.869078:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140724224 00000100:00100000:1.0:1788916888.869110:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140724224 00000100:00100000:1.0:1788916888.869197:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788916888.869208:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+16:5789:x1875815140724224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788916888.869227:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916888.869246:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83d74b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d744 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.869277:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83d74b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d744 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.869292:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83d74b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d744 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.869303:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeab600, rc 0) 00000100:00100000:1.0:1788916888.869352:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140724224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916888.869360:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788916888.869424:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140724224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788916888.869443:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaae00/0x51de7f756a83d744 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d74b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.869454:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaae00/0x51de7f756a83d744 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d74b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916888.869536:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140724352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.869565:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916888.869587:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788916888.869600:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140724352 00000100:00100000:1.0:1788916888.869613:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140724352 00000100:00100000:1.0:1788916888.869638:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788916888.869644:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140724352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.869946:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140724352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916888.869955:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788916888.869988:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140724352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.870037:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140724480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.870081:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916888.870096:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788916888.870108:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140724480 00000100:00100000:1.0:1788916888.870113:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140724480 00000100:00100000:1.0:1788916888.870135:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788916888.870141:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140724480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.870316:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140724480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916888.870322:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788916888.870361:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140724480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.887926:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8430:1875815140724608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788916888.888054:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916888.888103:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140724608 00000100:00100000:1.0:1788916888.888111:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140724608 00000100:00100000:1.0:1788916888.888188:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788916888.888200:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+17:8430:x1875815140724608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788916888.888479:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+17:8430:x1875815140724608:12345-0@lo:502:llog_process_th.0 Request processed in 278us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916888.888496:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788916888.888568:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788916888.888597:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8430:1875815140724608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788916888.888634:0:8430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788916888.888646:0:8430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788916888.888649:0:8430:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788916888.888659:0:8430:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6e3f439800 00000020:00000080:1.0:1788916888.888661:0:8430:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788916888.893728:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8430:1875815140724736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788916888.894126:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916888.894206:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cda300 going to sleep for 11 seconds 00000100:00100000:3.0:1788916888.894753:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140724736 00000100:00100000:3.0:1788916888.894764:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140724736 00000100:00100000:3.0:1788916888.894831:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788916888.894843:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+17:8430:x1875815140724736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788916888.895132:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+17:8430:x1875815140724736:12345-0@lo:502:llog_process_th.0 Request processed in 290us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916888.895141:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788916888.895239:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8430:1875815140724736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788916888.895277:0:8430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788916888.895286:0:8430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788916888.895288:0:8430:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788916888.895294:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788916888.897567:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788916888.897610:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788916888.897626:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaae00/0x51de7f756a83d744 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d74b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.897643:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaae00/0x51de7f756a83d744 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d74b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916888.897657:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788916888.897660:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e2c984800 from 4 10000000:01000000:1.0:1788916888.897664:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788916888.897716:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83d752 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.897724:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83d752 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.897737:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83d752 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916888.897771:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140724864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.903927:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916888.904043:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916888.908691:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140724864 00000100:00100000:0.0:1788916888.908712:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140724864 00000100:00100000:1.0:1788916888.909434:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788916888.909449:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140724864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788916888.909485:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916888.909518:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e1eeab400/0x51de7f756a83d759 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d752 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.909556:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e1eeab400/0x51de7f756a83d759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d752 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.909569:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e1eeab400/0x51de7f756a83d759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d752 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.909579:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeab400, rc 0) 00000100:00100000:1.0:1788916888.909690:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140724864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (5774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916888.909697:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788916888.909781:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140724864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788916888.909809:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83d752 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d759 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.909821:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83d752 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d759 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916888.909924:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140724992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.909966:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916888.910023:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788916888.910042:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140724992 00000100:00100000:1.0:1788916888.910048:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140724992 00000100:00100000:1.0:1788916888.910070:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788916888.910077:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140724992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.910403:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140724992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 325us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916888.910411:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788916888.910444:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140724992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.910487:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140725120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.910527:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916888.910544:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788916888.910554:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140725120 00000100:00100000:1.0:1788916888.910557:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140725120 00000100:00100000:1.0:1788916888.910576:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788916888.910581:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140725120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.910731:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140725120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916888.910738:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788916888.910778:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140725120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.911046:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8434:1875815140725248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788916888.911084:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916888.911102:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140725248 00000100:00100000:1.0:1788916888.911106:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140725248 00000100:00100000:1.0:1788916888.911128:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788916888.911134:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:8434:x1875815140725248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788916888.911296:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:8434:x1875815140725248:12345-0@lo:502:llog_process_th.0 Request processed in 162us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916888.911303:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788916888.911338:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e77b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788916888.911350:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8434:1875815140725248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788916888.911372:0:8434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788916888.911384:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788916888.911388:0:8434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788916888.911397:0:8434:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6e2c984800 00000020:00000080:1.0:1788916888.911400:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788916888.912006:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8434:1875815140725376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788916888.912055:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916888.912086:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140725376 00000100:00100000:1.0:1788916888.912091:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140725376 00000100:00100000:1.0:1788916888.912124:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788916888.912131:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+18:8434:x1875815140725376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788916888.912328:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+18:8434:x1875815140725376:12345-0@lo:502:llog_process_th.0 Request processed in 195us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916888.912335:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788916888.912390:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e77b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788916888.912408:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8434:1875815140725376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788916888.912430:0:8434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788916888.912436:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788916888.912438:0:8434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788916888.912443:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788916888.923439:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788916888.923493:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788916888.923512:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83d752 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d759 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.923529:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83d752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d759 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788916888.923542:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788916888.923546:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e171d2800 from 4 10000000:01000000:1.0:1788916888.923549:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788916888.923606:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa400/0x51de7f756a83d760 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.923615:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa400/0x51de7f756a83d760 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.923630:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa400/0x51de7f756a83d760 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916888.923677:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140725504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.923772:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916888.923817:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e77b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788916888.924181:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140725504 00000100:00100000:1.0:1788916888.924191:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140725504 00000100:00100000:1.0:1788916888.924250:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788916888.924261:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140725504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788916888.924279:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916888.924295:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e1eeaa600/0x51de7f756a83d767 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d760 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.924339:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e1eeaa600/0x51de7f756a83d767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d760 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.924353:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e1eeaa600/0x51de7f756a83d767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d760 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.924364:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeaa600, rc 0) 00000100:00100000:1.0:1788916888.924419:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140725504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916888.924428:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788916888.924499:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140725504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788916888.924517:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa400/0x51de7f756a83d760 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d767 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.924528:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa400/0x51de7f756a83d760 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d767 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916888.924596:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140725632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.924624:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916888.924747:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140725632 00000100:00100000:0.0:1788916888.924753:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140725632 00000100:00100000:0.0:1788916888.924781:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788916888.924790:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140725632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788916888.925099:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140725632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 310us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916888.925107:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788916888.926526:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e77b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788916888.926563:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140725632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.926624:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140725760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.926691:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916888.926730:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e77b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788916888.926759:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140725760 00000100:00100000:1.0:1788916888.926772:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140725760 00000100:00100000:1.0:1788916888.926819:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788916888.926828:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140725760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.927024:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140725760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916888.927032:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788916888.927085:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140725760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788916888.928452:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8436:1875815140725888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788916888.928544:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916888.928586:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140725888 00000100:00100000:1.0:1788916888.928592:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140725888 00000100:00100000:1.0:1788916888.928637:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788916888.929763:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:8436:x1875815140725888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788916888.930047:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:8436:x1875815140725888:12345-0@lo:502:llog_process_th.0 Request processed in 1400us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916888.930058:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788916888.930163:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e77540 going to sleep for 11 seconds 00000100:00100000:1.0:1788916888.930198:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8436:1875815140725888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788916888.930234:0:8436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788916888.930246:0:8436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788916888.930248:0:8436:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788916888.930258:0:8436:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6e171d2800 00000020:00000080:1.0:1788916888.930260:0:8436:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788916888.934478:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8436:1875815140726016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788916888.949518:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916888.949569:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140726016 00000100:00100000:1.0:1788916888.949587:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140726016 00000100:00100000:1.0:1788916888.952780:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788916888.952814:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:8436:x1875815140726016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788916888.953212:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:8436:x1875815140726016:12345-0@lo:502:llog_process_th.0 Request processed in 412us (3701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916888.953222:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788916888.953334:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e77540 going to sleep for 11 seconds 00000100:00100000:1.0:1788916888.953368:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:8436:1875815140726016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788916888.953412:0:8436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788916888.953422:0:8436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788916888.953425:0:8436:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788916888.953430:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788916888.953519:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788916888.953540:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788916888.953556:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa400/0x51de7f756a83d760 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d767 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916888.953569:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa400/0x51de7f756a83d760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d767 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916889.383905:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916889.995625:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916889.995680:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916889.995722:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916889.995740:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113432064 00000100:00100000:3.0:1788916889.995785:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113432064 00000100:00100000:2.0:1788916889.995791:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916889.995818:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113432192 00000100:00100000:2.0:1788916889.995822:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113432192 00000100:00100000:3.0:1788916889.995887:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:3.0:1788916889.995901:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2374:x1875815113432064:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916889.996017:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113431936 00000100:00100000:3.0:1788916889.996018:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2374:x1875815113432064:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 120us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916889.996022:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113431936 00000100:00100000:3.0:1788916889.996027:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:0.0:1788916889.996062:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:0.0:1788916889.996070:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2374:x1875815113431936:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788916889.996103:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113431808 00000100:00100000:0.0:1788916889.996104:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2374:x1875815113431936:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 35us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916889.996107:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113431808 00000100:00100000:0.0:1788916889.996110:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:1.0:1788916889.996136:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 195 00000100:00100000:1.0:1788916889.996172:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+10:2374:x1875815113431808:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788916889.996318:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:1.0:1788916889.996324:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+10:2374:x1875815113431808:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 181us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916889.996326:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2374:x1875815113432192:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788916889.996330:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 195 00000100:00100000:2.0:1788916889.996359:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2374:x1875815113432192:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 34us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916889.996366:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00080000:2.0:1788916889.999582:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788916889.999599:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788916889.999602:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788916890.400008:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916891.424682:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916892.191515:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140726400:0@lo:400:kworker.0 00000100:00100000:1.0:1788916892.191617:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916892.191689:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788916892.191696:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140726272:0@lo:400:kworker.0 00000100:00100000:1.0:1788916892.191721:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916892.191737:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140726784:0@lo:400:kworker.0 00000100:00100000:1.0:1788916892.191763:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916892.191808:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140726784 00000100:00100000:1.0:1788916892.191818:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140726784 00000100:00100000:1.0:1788916892.191903:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788916892.191914:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140726784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916892.191976:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140726784:12345-0@lo:400:kworker.0 Request processed in 64us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916892.191985:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788916892.192213:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e28d61880 x1875815140726784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916892.192230:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140726784:0@lo:400:kworker.0 00000100:00100000:2.0:1788916892.192325:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140726144:0@lo:400:kworker.0 00000100:00100000:2.0:1788916892.192364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916892.192400:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140726656:0@lo:400:kworker.0 00000100:00100000:2.0:1788916892.192424:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916892.192460:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788916892.192468:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140726528:0@lo:400:kworker.0 00000100:00100000:2.0:1788916892.192490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916892.192524:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140726400 00000100:00100000:2.0:1788916892.192529:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140726400 00000100:00100000:2.0:1788916892.192561:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140726272 00000100:00100000:2.0:1788916892.192563:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140726272 00000100:00100000:2.0:1788916892.192577:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140726656 00000100:00100000:2.0:1788916892.192580:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140726656 00000100:00100000:2.0:1788916892.192594:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788916892.192600:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140726400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916892.192645:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140726400:12345-0@lo:400:kworker.0 Request processed in 44us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916892.192651:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788916892.192667:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788916892.192673:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140726272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916892.192702:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140726272:12345-0@lo:400:kworker.0 Request processed in 29us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916892.192719:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788916892.192731:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788916892.192737:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140726656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916892.192776:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140726656:12345-0@lo:400:kworker.0 Request processed in 39us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916892.192782:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788916892.192805:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788916892.192811:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788916892.192821:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140726528 00000100:00100000:2.0:1788916892.192825:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140726528 00000100:00100000:2.0:1788916892.192861:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788916892.192867:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140726528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916892.192899:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140726528:12345-0@lo:400:kworker.0 Request processed in 33us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916892.192905:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788916892.192938:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788916892.192960:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e28d60380 x1875815140726528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916892.192970:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140726528:0@lo:400:kworker.0 00000100:00100000:2.0:1788916892.192980:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140726656:0@lo:400:kworker.0 00000100:00100000:2.0:1788916892.193010:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140726272:0@lo:400:kworker.0 00000100:00100000:2.0:1788916892.193021:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140726400:0@lo:400:kworker.0 00000100:00100000:1.0:1788916892.193108:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140726144 00000100:00100000:1.0:1788916892.193112:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140726144 00000100:00100000:1.0:1788916892.193181:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788916892.193189:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140726144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916892.193229:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140726144:12345-0@lo:400:kworker.0 Request processed in 41us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916892.193235:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788916892.193326:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140726144:0@lo:400:kworker.0 00010000:00010000:2.0:1788916892.448289:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916892.708860:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788916892.708895:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140726912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788916892.708987:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916892.709073:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140726912 00000100:00100000:3.0:1788916892.709083:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140726912 00000100:00100000:3.0:1788916892.709168:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788916892.709180:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140726912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788916892.709226:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788916892.709282:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140726912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916892.709290:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788916892.709337:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e1edf1500 x1875815140726912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916892.709359:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140726912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788916893.215310:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788916893.215345:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140727040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788916893.215461:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916893.216139:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140727040 00000100:00100000:3.0:1788916893.216204:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140727040 00000100:00100000:3.0:1788916893.216262:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788916893.216271:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140727040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788916893.216324:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788916893.216391:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140727040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916893.216414:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788916893.216454:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2d0b0380 x1875815140727040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916893.216482:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140727040:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788916893.484358:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916894.495445:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788916894.695817:0:8665:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1788916895.124571:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916895.124646:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916895.124696:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916895.124918:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113432576 00000100:00100000:1.0:1788916895.124934:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113432576 00000100:00100000:0.0:1788916895.125059:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113432448 00000100:00100000:0.0:1788916895.125064:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113432448 00000100:00100000:1.0:1788916895.125196:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:1.0:1788916895.125230:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2370:x1875815113432576:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:1.0:1788916895.125294:0:6592:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d6a3 00000100:00080000:1.0:1788916895.125308:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9a6e2d528800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788916895.125357:0:6592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788916895.125808:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+2:2370:x1875815113432576:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 580us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916895.125817:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:2.0:1788916895.126338:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113432320 00000100:00100000:2.0:1788916895.126347:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113432320 00000100:00100000:2.0:1788916895.126396:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 197 00000100:00100000:2.0:1788916895.126418:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+10:2372:x1875815113432320:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788916895.126474:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+10:2372:x1875815113432320:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 69us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916895.126481:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 197 00010000:00010000:1.0:1788916895.130390:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788916895.131391:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788916895.132471:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916895.132759:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113432704 00000100:00100000:3.0:1788916895.132776:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113432704 00000100:00100000:3.0:1788916895.132878:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:3.0:1788916895.132891:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2370:x1875815113432704:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:3.0:1788916895.133272:0:8068:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d6aa 00000100:00080000:3.0:1788916895.133286:0:8068:0:(import.c:65:import_set_state_nolock()) ffff9a6e36a31800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788916895.133342:0:8068:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788916895.133496:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916895.134204:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:0.0:1788916895.134219:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2372:x1875815113432448:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916895.134339:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2372:x1875815113432448:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 125us (9641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916895.134349:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:3.0:1788916895.136458:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+2:2370:x1875815113432704:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 3557us (3987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916895.136474:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00080000:2.0:1788916895.138263:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788916895.138273:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788916895.519379:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916896.543368:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916897.311847:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140727168:0@lo:400:kworker.0 00000100:00100000:2.0:1788916897.311960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916897.312453:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140727296:0@lo:400:kworker.0 00000100:00100000:0.0:1788916897.312497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916897.312533:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788916897.312539:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140727424:0@lo:400:kworker.0 00000100:00100000:0.0:1788916897.312562:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916897.312587:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140727552:0@lo:400:kworker.0 00000100:00100000:0.0:1788916897.312614:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916897.312650:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140727296 00000100:00100000:0.0:1788916897.312658:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140727296 00000100:00100000:0.0:1788916897.312703:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140727424 00000100:00100000:0.0:1788916897.312706:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140727424 00000100:00100000:0.0:1788916897.312736:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788916897.312746:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140727296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916897.312810:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140727296:12345-0@lo:400:kworker.0 Request processed in 65us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916897.312818:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788916897.312837:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788916897.312844:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140727424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916897.312870:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140727424:12345-0@lo:400:kworker.0 Request processed in 27us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916897.312876:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788916897.312909:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788916897.312954:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140727424:0@lo:400:kworker.0 00000100:00100000:0.0:1788916897.313427:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140727296:0@lo:400:kworker.0 00000100:00100000:0.0:1788916897.313486:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140727552 00000100:00100000:0.0:1788916897.313492:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140727552 00000100:00100000:0.0:1788916897.313558:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788916897.313566:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140727552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916897.313628:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140727552:12345-0@lo:400:kworker.0 Request processed in 51us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916897.313636:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788916897.313673:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e1edf3800 x1875815140727552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916897.313685:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140727552:0@lo:400:kworker.0 00000100:00080000:2.0:1788916897.314288:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788916897.315711:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140727168 00000100:00100000:1.0:1788916897.315726:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140727168 00000100:00100000:1.0:1788916897.315791:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788916897.315801:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140727168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916897.315907:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140727168:12345-0@lo:400:kworker.0 Request processed in 107us (3946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916897.316372:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788916897.317732:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140727168:0@lo:400:kworker.0 00000100:00100000:2.0:1788916897.319376:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788916897.319406:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140727808:0@lo:400:kworker.0 00000100:00100000:2.0:1788916897.319488:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916897.319539:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788916897.319557:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140727680:0@lo:400:kworker.0 00000100:00100000:2.0:1788916897.319585:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916897.319776:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140727808 00000100:00100000:3.0:1788916897.319783:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140727808 00000100:00100000:3.0:1788916897.319884:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788916897.319895:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140727808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916897.319962:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140727808:12345-0@lo:400:kworker.0 Request processed in 69us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916897.319970:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788916897.320859:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140727680 00000100:00100000:0.0:1788916897.320868:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140727680 00000100:00080000:2.0:1788916897.326524:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788916897.326540:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788916897.326641:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e1edf3800 x1875815140727808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916897.326661:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140727808:0@lo:400:kworker.0 00000100:00100000:0.0:1788916897.327882:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788916897.327898:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140727680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916897.328030:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140727680:12345-0@lo:400:kworker.0 Request processed in 136us (8442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916897.328038:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788916897.328083:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140727680:0@lo:400:kworker.0 00010000:00010000:1.0:1788916897.567657:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916897.823420:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140727936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788916897.823545:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916897.826316:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140727936 00000100:00100000:3.0:1788916897.826336:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140727936 00000100:00100000:3.0:1788916897.826424:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788916897.826438:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140727936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788916897.826527:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788916897.826649:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140727936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 215us (3105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916897.826658:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788916897.835047:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e1edf1f80 x1875815140727936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916897.835088:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140727936:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788916897.941124:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9afe8ff0-67c2-4292-b970-4ecb57096cb4 00000020:00000080:2.0:1788916897.941137:0:6617:0:(genops.c:907:class_export_put()) final put ffff9a6e3fe0b800/9afe8ff0-67c2-4292-b970-4ecb57096cb4 00000020:00000080:1.0:1788916897.941312:0:38:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e3fe0b800/9afe8ff0-67c2-4292-b970-4ecb57096cb4 for lustre-OST0000 00000020:00000080:1.0:1788916897.941460:0:38:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e2d528800 for lustre-OST0000 00000100:00100000:0.0:1788916898.336412:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140728064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788916898.336506:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916898.336596:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140728064 00000100:00100000:0.0:1788916898.336605:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140728064 00000100:00100000:0.0:1788916898.336658:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788916898.336669:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140728064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788916898.336730:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788916898.336781:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140728064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916898.336789:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788916898.336837:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2d0b0380 x1875815140728064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916898.336859:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140728064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788916898.592178:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788916899.462577:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9afe8ff0-67c2-4292-b970-4ecb57096cb4 00000020:00000080:2.0:1788916899.462591:0:7503:0:(genops.c:907:class_export_put()) final put ffff9a6e2d52b800/9afe8ff0-67c2-4292-b970-4ecb57096cb4 00000020:00000080:3.0:1788916899.462806:0:38:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e2d52b800/9afe8ff0-67c2-4292-b970-4ecb57096cb4 for lustre-OST0001 00000020:00000080:3.0:1788916899.462865:0:38:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e36a31800 for lustre-OST0001 00010000:00010000:1.0:1788916899.615319:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916900.235341:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916900.235732:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916900.236390:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113432832 00000100:00100000:2.0:1788916900.236401:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113432832 00000100:00100000:2.0:1788916900.236467:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 199 00000100:00100000:2.0:1788916900.236478:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+10:2372:x1875815113432832:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788916900.236570:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+10:2372:x1875815113432832:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 93us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916900.236577:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 199 00000100:00100000:3.0:1788916900.236847:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113432960 00000100:00100000:3.0:1788916900.236853:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113432960 00000100:00100000:3.0:1788916900.236909:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:3.0:1788916900.236918:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2372:x1875815113432960:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788916900.236957:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2372:x1875815113432960:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 41us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916900.236963:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00080000:2.0:1788916900.238213:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788916900.643781:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788916900.830401:0:8912:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing yml_node 00010000:00010000:1.0:1788916901.664960:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916902.434263:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140728192:0@lo:400:kworker.0 00000100:00100000:1.0:1788916902.434366:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916902.434419:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140728704:0@lo:400:kworker.0 00000100:00100000:1.0:1788916902.434449:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916902.434479:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788916902.434485:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140728576:0@lo:400:kworker.0 00000100:00100000:1.0:1788916902.434513:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916902.434544:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140728320:0@lo:400:kworker.0 00000100:00100000:1.0:1788916902.434568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916902.434594:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140728832:0@lo:400:kworker.0 00000100:00100000:1.0:1788916902.434616:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916902.434636:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788916902.434642:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140728448:0@lo:400:kworker.0 00000100:00100000:1.0:1788916902.434665:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916902.434698:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140728192 00000100:00100000:1.0:1788916902.434705:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140728192 00000100:00100000:1.0:1788916902.434754:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788916902.434763:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140728192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916902.434817:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140728192:12345-0@lo:400:kworker.0 Request processed in 54us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916902.434839:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788916902.434875:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140728704 00000100:00100000:1.0:1788916902.434880:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140728704 00000100:00100000:1.0:1788916902.434915:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140728320 00000100:00100000:1.0:1788916902.434919:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140728320 00000100:00100000:1.0:1788916902.434930:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140728448 00000100:00100000:1.0:1788916902.434932:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140728448 00000100:00100000:1.0:1788916902.434966:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788916902.434972:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140728704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916902.435006:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140728704:12345-0@lo:400:kworker.0 Request processed in 34us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916902.435013:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788916902.435026:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788916902.435032:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140728320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916902.435064:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140728320:12345-0@lo:400:kworker.0 Request processed in 32us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916902.435070:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788916902.435084:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788916902.435091:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140728448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916902.435115:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140728448:12345-0@lo:400:kworker.0 Request processed in 26us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916902.435122:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788916902.435139:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140728576 00000100:00100000:1.0:1788916902.435143:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140728576 00000100:00100000:1.0:1788916902.435200:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140728832 00000100:00100000:1.0:1788916902.435203:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140728832 00000100:00100000:1.0:1788916902.435222:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788916902.435235:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140728576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916902.435267:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140728576:12345-0@lo:400:kworker.0 Request processed in 32us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916902.435272:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788916902.435284:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788916902.435289:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140728832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916902.435316:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140728832:12345-0@lo:400:kworker.0 Request processed in 26us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916902.435322:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788916902.435379:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e28d60380 x1875815140728576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916902.435394:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140728576:0@lo:400:kworker.0 00000100:00100000:1.0:1788916902.435405:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140728192:0@lo:400:kworker.0 00000100:00100000:1.0:1788916902.435415:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140728704:0@lo:400:kworker.0 00000100:00080000:1.0:1788916902.435442:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788916902.435446:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788916902.435449:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788916902.435467:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140728448:0@lo:400:kworker.0 00000100:00100000:1.0:1788916902.435478:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140728320:0@lo:400:kworker.0 00010000:00080000:1.0:1788916902.435487:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e28c2f100 x1875815140728832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916902.435494:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140728832:0@lo:400:kworker.0 00010000:00010000:2.0:1788916902.687536:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916902.944712:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788916902.944744:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140728960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788916902.944833:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916902.944963:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140728960 00000100:00100000:3.0:1788916902.944975:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140728960 00000100:00100000:3.0:1788916902.945037:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788916902.945047:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140728960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788916902.946443:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788916902.946558:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140728960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1508us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916902.946569:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788916902.946642:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e1edf0a80 x1875815140728960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916902.946668:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140728960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788916903.455731:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788916903.455760:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140729088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788916903.455878:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916903.456028:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140729088 00000100:00100000:3.0:1788916903.456051:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140729088 00000100:00100000:3.0:1788916903.456107:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788916903.456117:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140729088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788916903.456188:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788916903.456252:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140729088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916903.456261:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788916903.456500:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2d0b0380 x1875815140729088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916903.456522:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140729088:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788916903.711532:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788916904.623859:0:9105:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.55.26 00010000:00010000:1.0:1788916904.737349:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916905.352047:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916905.352101:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916905.352135:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113433088 00000100:00100000:3.0:1788916905.352168:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113433088 00000100:00100000:3.0:1788916905.352232:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 201 00000100:00100000:3.0:1788916905.352242:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+10:2371:x1875815113433088:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788916905.352335:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+10:2371:x1875815113433088:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 94us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916905.352342:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 201 00000100:00100000:0.0:1788916905.353420:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113433216 00000100:00100000:0.0:1788916905.353429:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113433216 00000100:00100000:0.0:1788916905.353492:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:0.0:1788916905.353501:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2371:x1875815113433216:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916905.353558:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2371:x1875815113433216:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 58us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916905.353565:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00080000:3.0:1788916905.354231:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788916905.759355:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916906.783618:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788916906.834552:0:9202:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.55.26 00000100:00100000:3.0:1788916907.551575:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140729344:0@lo:400:kworker.0 00000100:00100000:1.0:1788916907.551611:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140729216:0@lo:400:kworker.0 00000100:00100000:3.0:1788916907.551625:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140729472:0@lo:400:kworker.0 00000100:00100000:1.0:1788916907.556251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916907.556339:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140729728:0@lo:400:kworker.0 00000100:00100000:1.0:1788916907.556389:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916907.556419:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788916907.556427:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140729600:0@lo:400:kworker.0 00000100:00100000:1.0:1788916907.556451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916907.556492:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140729216 00000100:00100000:1.0:1788916907.556500:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140729216 00000100:00100000:1.0:1788916907.556547:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788916907.556555:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140729216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916907.556605:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140729216:12345-0@lo:400:kworker.0 Request processed in 50us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916907.556613:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788916907.556648:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140729728 00000100:00100000:1.0:1788916907.556652:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140729728 00000100:00100000:1.0:1788916907.556684:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788916907.556691:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140729728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916907.556721:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140729728:12345-0@lo:400:kworker.0 Request processed in 31us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916907.556728:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788916907.556745:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140729600 00000100:00100000:1.0:1788916907.556748:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140729600 00000100:00100000:1.0:1788916907.557881:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788916907.557905:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140729600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916907.558011:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140729600:12345-0@lo:400:kworker.0 Request processed in 115us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916907.558018:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788916907.558051:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788916907.558056:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788916907.558073:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788916907.558090:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2c991180 x1875815140729600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916907.558105:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140729600:0@lo:400:kworker.0 00000100:00100000:1.0:1788916907.558116:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140729216:0@lo:400:kworker.0 00000100:00100000:1.0:1788916907.558126:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140729728:0@lo:400:kworker.0 00000100:00100000:3.0:1788916907.558369:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140729472 00000100:00100000:3.0:1788916907.558375:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140729472 00000100:00100000:3.0:1788916907.558415:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788916907.558422:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140729472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916907.558462:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140729472:12345-0@lo:400:kworker.0 Request processed in 42us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916907.558483:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788916907.558517:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140729472:0@lo:400:kworker.0 00000100:00100000:2.0:1788916907.560016:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916907.560065:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140729856:0@lo:400:kworker.0 00000100:00100000:2.0:1788916907.560119:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916907.560298:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140729344 00000100:00100000:3.0:1788916907.560305:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140729344 00000100:00100000:3.0:1788916907.560348:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788916907.560357:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140729344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916907.560553:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140729856 00000100:00100000:1.0:1788916907.560557:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140729856 00000100:00100000:1.0:1788916907.560590:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788916907.560597:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140729856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916907.567628:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140729344:12345-0@lo:400:kworker.0 Request processed in 7261us (7605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916907.567643:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788916907.571821:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788916907.571831:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788916907.573924:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140729856:12345-0@lo:400:kworker.0 Request processed in 13319us (13796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916907.573939:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788916907.581088:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140729344:0@lo:400:kworker.0 00010000:00080000:2.0:1788916907.581136:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2c993800 x1875815140729856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916907.581164:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140729856:0@lo:400:kworker.0 00010000:00010000:0.0:1788916907.807510:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916908.063702:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788916908.063728:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140729984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788916908.063814:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916908.063899:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140729984 00000100:00100000:1.0:1788916908.063908:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140729984 00000100:00100000:1.0:1788916908.063957:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788916908.063967:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140729984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788916908.064017:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916908.064064:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140729984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916908.064072:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788916908.064398:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e28c2e300 x1875815140729984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916908.064417:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140729984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788916908.577324:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140730112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788916908.577419:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916908.577679:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140730112 00000100:00100000:1.0:1788916908.577690:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140730112 00000100:00100000:1.0:1788916908.577757:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788916908.577768:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c991500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140730112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788916908.577821:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1788916908.584548:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2d0b0380 x1875815140730112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916908.584598:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140730112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788916908.584900:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c991500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140730112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7131us (7478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916908.584914:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788916908.831781:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788916909.490631:0:9300:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.55.26 00010000:00010000:0.0:1788916909.855622:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916910.484853:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916910.484905:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916910.484953:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113433472 00000100:00100000:0.0:1788916910.484965:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113433472 00000100:00080000:3.0:1788916910.485019:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788916910.485041:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:0.0:1788916910.485051:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2372:x1875815113433472:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788916910.485086:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113433344 00000100:00100000:1.0:1788916910.485092:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113433344 00000100:00100000:1.0:1788916910.485130:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 203 00000100:00100000:0.0:1788916910.485131:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c990a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2372:x1875815113433472:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 82us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916910.485162:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+10:2372:x1875815113433344:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788916910.485194:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+10:2372:x1875815113433344:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 54us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916910.485201:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 203 00000100:00100000:0.0:1788916910.485220:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00000001:02000400:0.0:1788916910.796293:0:9348:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 21:21:48 EDT 2026 00010000:00010000:1.0:1788916910.879412:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916911.908768:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916912.672387:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140730240:0@lo:400:kworker.0 00000100:00100000:1.0:1788916912.672472:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916912.672558:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140730240 00000100:00100000:3.0:1788916912.672566:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140730240 00000100:00100000:3.0:1788916912.672612:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788916912.672623:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140730240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916912.676056:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140730368:0@lo:400:kworker.0 00000100:00100000:1.0:1788916912.676162:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916912.676204:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788916912.676210:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140730496:0@lo:400:kworker.0 00000100:00100000:1.0:1788916912.676237:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916912.676377:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140730240:12345-0@lo:400:kworker.0 Request processed in 3753us (3902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916912.676404:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788916912.676462:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140730368 00000100:00100000:3.0:1788916912.676471:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140730368 00000100:00100000:3.0:1788916912.676517:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140730496 00000100:00100000:3.0:1788916912.676520:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140730496 00000100:00100000:3.0:1788916912.676552:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788916912.676563:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140730368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916912.676624:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140730368:12345-0@lo:400:kworker.0 Request processed in 64us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916912.676631:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788916912.676642:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788916912.676648:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140730496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916912.676674:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140730496:12345-0@lo:400:kworker.0 Request processed in 26us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916912.676680:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788916912.676698:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788916912.677933:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140730624:0@lo:400:kworker.0 00000100:00100000:0.0:1788916912.677982:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916912.678023:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788916912.678030:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140730752:0@lo:400:kworker.0 00000100:00100000:0.0:1788916912.678066:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916912.678942:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788916912.678958:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140730880:0@lo:400:kworker.0 00000100:00100000:3.0:1788916912.678994:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916912.679030:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140730752 00000100:00100000:3.0:1788916912.679037:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140730752 00000100:00100000:3.0:1788916912.679086:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788916912.679094:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140730752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916912.679198:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140730624 00000100:00100000:2.0:1788916912.679203:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140730624 00000100:00100000:2.0:1788916912.679232:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140730880 00000100:00100000:2.0:1788916912.679235:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140730880 00000100:00100000:2.0:1788916912.679267:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788916912.679275:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140730624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916912.679337:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140730624:12345-0@lo:400:kworker.0 Request processed in 63us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916912.679345:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788916912.679361:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788916912.679366:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140730880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916912.679398:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140730880:12345-0@lo:400:kworker.0 Request processed in 32us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916912.679404:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788916912.679438:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e06f08700 x1875815140730880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916912.679452:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140730880:0@lo:400:kworker.0 00010000:00080000:2.0:1788916912.679487:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e06f09f80 x1875815140730624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916912.679497:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140730624:0@lo:400:kworker.0 00000100:00100000:3.0:1788916912.679976:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140730752:12345-0@lo:400:kworker.0 Request processed in 882us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916912.679984:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1788916912.680011:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788916912.680016:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788916912.680019:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788916912.680074:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140730752:0@lo:400:kworker.0 00000100:00100000:1.0:1788916912.681072:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140730240:0@lo:400:kworker.0 00000100:00100000:1.0:1788916912.681268:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140730496:0@lo:400:kworker.0 00000100:00100000:1.0:1788916912.681283:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140730368:0@lo:400:kworker.0 00010000:00010000:1.0:1788916912.928310:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916913.183513:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140731008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788916913.183650:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916913.183729:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140731008 00000100:00100000:1.0:1788916913.183739:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140731008 00000100:00100000:1.0:1788916913.183786:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788916913.183796:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140731008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788916913.183837:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916913.183884:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140731008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916913.183891:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788916913.183933:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e1edf2d80 x1875815140731008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916913.183953:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140731008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788916913.697029:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140731136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788916913.697142:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916913.697270:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140731136 00000100:00100000:2.0:1788916913.697281:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140731136 00000100:00100000:2.0:1788916913.697346:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788916913.697357:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140731136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788916913.697407:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788916913.697458:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140731136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916913.697466:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788916913.697515:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e06f08000 x1875815140731136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916913.697538:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140731136:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788916913.951907:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916914.975564:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916915.592470:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916915.592580:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113433728 00000100:00100000:1.0:1788916915.592596:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113433728 00000100:00100000:1.0:1788916915.592700:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:1.0:1788916915.592713:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2373:x1875815113433728:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788916915.592821:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2373:x1875815113433728:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 110us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916915.592830:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00080000:3.0:1788916915.593238:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788916915.603251:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916915.603307:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113433600 00000100:00100000:1.0:1788916915.603319:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113433600 00000100:00100000:1.0:1788916915.603716:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 205 00000100:00100000:1.0:1788916915.603732:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+10:2374:x1875815113433600:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788916915.603851:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+10:2374:x1875815113433600:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 124us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916915.603861:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 205 00010000:00010000:2.0:1788916915.999816:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916917.027942:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916917.793370:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140731264:0@lo:400:kworker.0 00000100:00100000:3.0:1788916917.793476:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916917.793560:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140731776:0@lo:400:kworker.0 00000100:00100000:3.0:1788916917.793603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916917.793633:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788916917.793640:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140731648:0@lo:400:kworker.0 00000100:00100000:3.0:1788916917.793669:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916917.793706:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140731392:0@lo:400:kworker.0 00000100:00100000:3.0:1788916917.793732:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916917.793751:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f626a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140731904:0@lo:400:kworker.0 00000100:00100000:3.0:1788916917.793774:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916917.793794:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788916917.793800:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140731520:0@lo:400:kworker.0 00000100:00100000:3.0:1788916917.793823:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916917.793861:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140731264 00000100:00100000:3.0:1788916917.793871:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140731264 00000100:00100000:3.0:1788916917.793929:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788916917.793940:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140731264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916917.794002:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140731264:12345-0@lo:400:kworker.0 Request processed in 64us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916917.794009:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788916917.794051:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140731776 00000100:00100000:3.0:1788916917.794066:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140731776 00000100:00100000:3.0:1788916917.794103:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140731392 00000100:00100000:3.0:1788916917.794106:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140731392 00000100:00100000:3.0:1788916917.794118:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140731520 00000100:00100000:3.0:1788916917.794121:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140731520 00000100:00100000:3.0:1788916917.794135:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788916917.794141:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140731776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916917.794228:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140731776:12345-0@lo:400:kworker.0 Request processed in 86us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916917.794235:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788916917.794247:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788916917.794268:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140731392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916917.794302:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f624700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140731392:12345-0@lo:400:kworker.0 Request processed in 49us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916917.794308:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788916917.794319:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788916917.794325:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140731520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916917.794352:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140731520:12345-0@lo:400:kworker.0 Request processed in 28us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916917.794358:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788916917.794377:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140731648 00000100:00100000:3.0:1788916917.794381:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140731648 00000100:00100000:3.0:1788916917.794412:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140731904 00000100:00100000:3.0:1788916917.794416:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140731904 00000100:00100000:3.0:1788916917.794437:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788916917.794443:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f624000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140731648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916917.794474:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f624000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140731648:12345-0@lo:400:kworker.0 Request processed in 31us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916917.794491:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788916917.794503:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788916917.794509:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140731904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916917.794538:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140731904:12345-0@lo:400:kworker.0 Request processed in 29us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916917.794544:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788916917.794580:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788916917.794585:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788916917.794588:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788916917.794636:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140731520:0@lo:400:kworker.0 00000100:00100000:3.0:1788916917.794650:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140731392:0@lo:400:kworker.0 00010000:00080000:3.0:1788916917.794664:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e3f626a00 x1875815140731904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916917.794674:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f626a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140731904:0@lo:400:kworker.0 00010000:00080000:3.0:1788916917.794710:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2c990e00 x1875815140731648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916917.794719:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140731648:0@lo:400:kworker.0 00000100:00100000:3.0:1788916917.794728:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140731264:0@lo:400:kworker.0 00000100:00100000:3.0:1788916917.794737:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140731776:0@lo:400:kworker.0 00010000:00010000:2.0:1788916918.047827:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916918.305396:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788916918.305432:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140732032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788916918.305537:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916918.305620:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140732032 00000100:00100000:2.0:1788916918.305631:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140732032 00000100:00100000:2.0:1788916918.305694:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788916918.305705:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140732032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788916918.305751:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788916918.305828:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140732032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916918.305836:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788916918.306117:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e06f08000 x1875815140732032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916918.306178:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140732032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788916918.817643:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788916918.817678:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140732160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788916918.817775:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916918.817923:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140732160 00000100:00100000:2.0:1788916918.817936:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140732160 00000100:00100000:2.0:1788916918.818005:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788916918.818017:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140732160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788916918.818077:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788916918.818174:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140732160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916918.818182:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788916918.818509:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e06f0ad80 x1875815140732160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916918.818532:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140732160:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788916919.071584:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916920.096831:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916920.711526:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916920.711576:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916920.711618:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113433984 00000100:00100000:0.0:1788916920.711628:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113433984 00000100:00100000:0.0:1788916920.711697:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:0.0:1788916920.711707:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2373:x1875815113433984:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916920.711791:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2373:x1875815113433984:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 86us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916920.711799:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00080000:0.0:1788916920.711820:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788916920.713037:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113433856 00000100:00100000:3.0:1788916920.713046:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113433856 00000100:00100000:3.0:1788916920.713089:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 207 00000100:00100000:3.0:1788916920.713109:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+10:2374:x1875815113433856:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788916920.713185:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+10:2374:x1875815113433856:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 76us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916920.713192:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 207 00010000:00010000:3.0:1788916921.119898:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916922.149525:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916922.914839:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140732416:0@lo:400:kworker.0 00000100:00100000:2.0:1788916922.914939:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916922.915015:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140732928:0@lo:400:kworker.0 00000100:00100000:2.0:1788916922.915043:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916922.915072:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788916922.915079:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140732544:0@lo:400:kworker.0 00000100:00100000:2.0:1788916922.915101:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916922.915179:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140732416 00000100:00100000:0.0:1788916922.915201:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140732416 00000100:00100000:0.0:1788916922.915256:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140732544 00000100:00100000:0.0:1788916922.915259:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140732544 00000100:00100000:0.0:1788916922.915293:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788916922.915304:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140732416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916922.915367:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140732416:12345-0@lo:400:kworker.0 Request processed in 65us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916922.915374:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788916922.915390:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788916922.915396:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140732544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916922.915424:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140732544:12345-0@lo:400:kworker.0 Request processed in 28us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916922.915430:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788916922.915446:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788916922.915480:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140732544:0@lo:400:kworker.0 00000100:00100000:0.0:1788916922.915490:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140732416:0@lo:400:kworker.0 00000100:00100000:1.0:1788916922.915602:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140732288:0@lo:400:kworker.0 00000100:00100000:1.0:1788916922.915638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916922.915673:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140732800:0@lo:400:kworker.0 00000100:00100000:1.0:1788916922.915695:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916922.915729:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788916922.915735:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140732672:0@lo:400:kworker.0 00000100:00100000:1.0:1788916922.915759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916922.915837:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140732800 00000100:00100000:0.0:1788916922.915842:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140732800 00000100:00100000:0.0:1788916922.915879:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788916922.915885:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140732800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916922.915918:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140732800:12345-0@lo:400:kworker.0 Request processed in 34us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916922.915924:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788916922.915984:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140732288 00000100:00100000:2.0:1788916922.915988:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140732288 00000100:00100000:2.0:1788916922.916027:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788916922.916034:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b462050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140732288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916922.916066:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b462050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140732288:12345-0@lo:400:kworker.0 Request processed in 33us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916922.916073:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788916922.916235:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140732928 00000100:00100000:3.0:1788916922.916239:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140732928 00000100:00100000:3.0:1788916922.916276:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140732672 00000100:00100000:3.0:1788916922.916280:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140732672 00000100:00100000:3.0:1788916922.916309:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788916922.916318:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140732928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916922.916367:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140732928:12345-0@lo:400:kworker.0 Request processed in 51us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916922.916373:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788916922.916388:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788916922.916395:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140732672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916922.916423:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140732672:12345-0@lo:400:kworker.0 Request processed in 29us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916922.916429:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788916922.916472:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e0821f100 x1875815140732928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916922.916483:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140732928:0@lo:400:kworker.0 00000100:00080000:1.0:1788916922.916768:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788916922.916772:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788916922.916775:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788916922.916796:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e0821d500 x1875815140732672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916922.916807:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140732672:0@lo:400:kworker.0 00000100:00100000:1.0:1788916922.916816:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140732288:0@lo:400:kworker.0 00000100:00100000:1.0:1788916922.916825:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140732800:0@lo:400:kworker.0 00010000:00010000:3.0:1788916923.167858:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916923.424704:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788916923.424729:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140733056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788916923.427026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916923.433076:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140733056 00000100:00100000:0.0:1788916923.433092:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140733056 00000100:00100000:0.0:1788916923.433580:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788916923.433594:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140733056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788916923.433657:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788916923.433782:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140733056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 192us (6762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916923.433790:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788916923.433905:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e06f0bb80 x1875815140733056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916923.433928:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140733056:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788916923.922946:0:9977:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:22:01 (1788916921) === 00000100:00100000:1.0:1788916923.939906:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788916923.939933:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140733184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788916923.940017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916923.940085:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140733184 00000100:00100000:1.0:1788916923.940093:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140733184 00000100:00100000:1.0:1788916923.940167:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788916923.940177:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140733184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788916923.940217:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916923.940262:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140733184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916923.940269:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788916923.940313:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e28d62680 x1875815140733184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916923.940333:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140733184:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788916924.191844:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916924.327796:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916924.328305:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113434112 00000100:00100000:3.0:1788916924.328317:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113434112 00000100:00100000:3.0:1788916924.328376:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 209 00000100:00100000:3.0:1788916924.328383:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+10:8148:x1875815113434112:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788916924.328399:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916924.328415:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e2d18fe00/0x51de7f756a83d76e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f419 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916924.328439:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e2d18fe00/0x51de7f756a83d76e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f419 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916924.328447:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e2d18fe00/0x51de7f756a83d76e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f419 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916924.328456:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18fe00, rc 0) 00000100:00100000:3.0:1788916924.328526:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+11:8148:x1875815113434112:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 142us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916924.328533:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 209 00000100:00100000:0.0:1788916924.338314:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916924.338566:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113434240 00000100:00100000:3.0:1788916924.338579:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113434240 00000100:00100000:3.0:1788916924.338689:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 210 00000100:00100000:3.0:1788916924.338701:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+11:8148:x1875815113434240:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788916924.339270:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+11:8148:x1875815113434240:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 569us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916924.339290:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 210 00000100:00100000:1.0:1788916924.347910:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916924.348036:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113434368 00000100:00100000:0.0:1788916924.348050:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113434368 00000100:00100000:0.0:1788916924.348111:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 211 00000100:00100000:0.0:1788916924.348123:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+11:8148:x1875815113434368:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788916924.348408:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+11:8148:x1875815113434368:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 287us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916924.348414:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 211 00000100:00100000:1.0:1788916924.350971:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916924.351085:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113434496 00000100:00100000:3.0:1788916924.351099:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113434496 00000100:00100000:3.0:1788916924.351215:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 212 00000100:00100000:3.0:1788916924.351228:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+11:8152:x1875815113434496:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788916924.351559:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+11:8152:x1875815113434496:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 334us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916924.351565:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 212 00000100:00100000:2.0:1788916924.371882:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916924.372023:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113434624 00000100:00100000:0.0:1788916924.372034:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113434624 00000100:00100000:0.0:1788916924.372098:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 213 00000100:00100000:0.0:1788916924.372110:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+11:8152:x1875815113434624:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788916924.372500:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+11:8152:x1875815113434624:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 391us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916924.372510:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 213 00000100:00100000:1.0:1788916924.382092:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916924.382460:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113434752 00000100:00100000:0.0:1788916924.382472:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113434752 00000100:00100000:0.0:1788916924.382554:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 214 00000100:00100000:0.0:1788916924.382568:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+11:8148:x1875815113434752:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788916924.382592:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916924.382648:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee3600/0x51de7f756a83d775 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f443 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916924.382692:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee3600/0x51de7f756a83d775 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f443 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916924.382705:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee3600/0x51de7f756a83d775 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f443 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916924.382716:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3600, rc 0) 00000100:00100000:0.0:1788916924.383032:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+12:8148:x1875815113434752:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 465us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916924.383039:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 214 00000100:00100000:1.0:1788916924.386043:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916924.386189:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113434880 00000100:00100000:0.0:1788916924.386201:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113434880 00000100:00100000:0.0:1788916924.386263:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 215 00000100:00100000:0.0:1788916924.386273:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+12:8148:x1875815113434880:12345-192.168.202.40@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788916924.386305:0:5784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788916924.386334:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788916924.386338:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788916924.386341:0:5784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788916924.386343:0:5784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788916924.388348:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+12:8148:x1875815113434880:12345-192.168.202.40@tcp:256:mount.lustre.0 Request processed in 2066us (2304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916924.388365:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 215 00000100:00100000:1.0:1788916924.392264:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916924.392519:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113435008 00000100:00100000:0.0:1788916924.392530:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113435008 00000100:00100000:0.0:1788916924.392633:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 216 00000100:00100000:0.0:1788916924.392644:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+12:8148:x1875815113435008:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788916924.392679:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916924.392699:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d77c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f44a expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916924.392728:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d77c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f44a expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916924.392750:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d77c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f44a expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916924.392759:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2e00, rc 0) 00000100:00100000:0.0:1788916924.392826:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+13:8148:x1875815113435008:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 184us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916924.392834:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 216 00000100:00100000:1.0:1788916924.394793:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916924.394997:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113435136 00000100:00100000:0.0:1788916924.395006:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113435136 00000100:00100000:0.0:1788916924.395094:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 217 00000100:00100000:0.0:1788916924.395105:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:8148:x1875815113435136:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788916924.395544:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:8148:x1875815113435136:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 439us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916924.395553:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 217 00000100:00100000:2.0:1788916924.398033:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916924.398180:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113435264 00000100:00100000:0.0:1788916924.398192:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113435264 00000100:00100000:0.0:1788916924.398289:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 218 00000100:00100000:0.0:1788916924.398301:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+13:8148:x1875815113435264:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788916924.398580:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+13:8148:x1875815113435264:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 280us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916924.398596:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 218 00000100:00100000:1.0:1788916924.403661:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916924.403790:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113435392 00000100:00100000:0.0:1788916924.403801:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113435392 00000100:00100000:0.0:1788916924.403896:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 219 00000100:00100000:0.0:1788916924.403909:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:8156:x1875815113435392:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788916924.404262:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:8156:x1875815113435392:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 355us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916924.404270:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 219 00000100:00100000:1.0:1788916924.407855:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916924.408126:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113435520 00000100:00100000:0.0:1788916924.408184:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113435520 00000100:00100000:0.0:1788916924.408252:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 220 00000100:00100000:0.0:1788916924.408263:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+13:8156:x1875815113435520:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788916924.408529:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+13:8156:x1875815113435520:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 267us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916924.408538:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 220 00000100:00100000:2.0:1788916924.411826:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916924.411874:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916924.412206:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113436032 00000100:00100000:3.0:1788916924.412221:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113436032 00000100:00100000:3.0:1788916924.412294:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113435648 00000100:00100000:3.0:1788916924.412297:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113435648 00000100:00100000:3.0:1788916924.412323:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:3.0:1788916924.412336:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2374:x1875815113436032:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788916924.412419:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2374:x1875815113436032:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 86us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916924.412427:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:3.0:1788916924.412464:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:3.0:1788916924.412469:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2370:x1875815113435648:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788916924.412495:0:5793:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 3e1d3733-3759-4aa4-b321-e9a62c258363@192.168.202.40@tcp t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:3.0:1788916924.412535:0:5793:0:(genops.c:1407:class_connect()) connect: client 3e1d3733-3759-4aa4-b321-e9a62c258363, cookie 0x51de7f756a83d783 00000004:00100000:3.0:1788916924.412573:0:5793:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788916924.412855:0:5793:0:(import.c:65:import_set_state_nolock()) ffff9a6e3f7fd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788916924.413475:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+6:2370:x1875815113435648:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 1001us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916924.413500:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00080000:1.0:1788916924.413760:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788916924.416800:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916924.416844:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916924.416984:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113435776 00000100:00100000:3.0:1788916924.416996:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113435776 00000100:00100000:3.0:1788916924.417077:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113435904 00000100:00100000:3.0:1788916924.417081:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113435904 00000100:00100000:3.0:1788916924.417111:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:3.0:1788916924.417123:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+7:0:x1875815113435776:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788916924.417217:0:5793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788916924.417307:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+7:0:x1875815113435776:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 187us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916924.417314:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:3.0:1788916924.417346:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:3.0:1788916924.417352:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+6:8148:x1875815113435904:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788916924.417363:0:5793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788916924.417385:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+6:8148:x1875815113435904:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 33us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916924.417391:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00080000:2.0:1788916924.417486:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788916924.422570:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916924.422716:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113436160 00000100:00100000:3.0:1788916924.422729:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113436160 00000100:00100000:3.0:1788916924.422810:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:3.0:1788916924.422822:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+6:8148:x1875815113436160:12345-192.168.202.40@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788916924.423068:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+6:8148:x1875815113436160:12345-192.168.202.40@tcp:40:mount.lustre.0 Request processed in 247us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916924.423077:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:2.0:1788916924.429771:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916924.429899:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113436288 00000100:00100000:3.0:1788916924.429923:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113436288 00000100:00100000:3.0:1788916924.429980:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:3.0:1788916924.429990:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2370:x1875815113436288:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788916924.430029:0:6593:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 3e1d3733-3759-4aa4-b321-e9a62c258363@192.168.202.40@tcp t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:3.0:1788916924.430062:0:6593:0:(genops.c:1407:class_connect()) connect: client 3e1d3733-3759-4aa4-b321-e9a62c258363, cookie 0x51de7f756a83d78a 00002000:00100000:3.0:1788916924.430075:0:6593:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3e1d3733-3759-4aa4-b321-e9a62c258363/ffff9a6e3f7fc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788916924.430088:0:6593:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788916924.430399:0:6593:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788916924.430434:0:6593:0:(import.c:65:import_set_state_nolock()) ffff9a6e3f7fa000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788916924.430521:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e1d3733-3759-4aa4-b321-e9a62c258363+6:2370:x1875815113436288:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 531us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916924.430530:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:1.0:1788916924.432436:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916924.433707:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916924.433979:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113436416 00000100:00100000:0.0:1788916924.433991:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113436416 00000100:00100000:0.0:1788916924.434042:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:0.0:1788916924.434052:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2370:x1875815113436416:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788916924.434091:0:8068:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 3e1d3733-3759-4aa4-b321-e9a62c258363@192.168.202.40@tcp t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:0.0:1788916924.434127:0:8068:0:(genops.c:1407:class_connect()) connect: client 3e1d3733-3759-4aa4-b321-e9a62c258363, cookie 0x51de7f756a83d791 00000100:00100000:3.0:1788916924.434263:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113436544 00000100:00100000:3.0:1788916924.434270:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113436544 00002000:00100000:0.0:1788916924.434300:0:8068:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3e1d3733-3759-4aa4-b321-e9a62c258363/ffff9a6e0758c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788916924.434315:0:8068:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788916924.434323:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:3.0:1788916924.434334:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e1d3733-3759-4aa4-b321-e9a62c258363+6:8148:x1875815113436544:12345-192.168.202.40@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788916924.434583:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00002000:00080000:0.0:1788916924.434834:0:8068:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1788916924.434835:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e1d3733-3759-4aa4-b321-e9a62c258363+6:8148:x1875815113436544:12345-192.168.202.40@tcp:33:mount.lustre.0 Request processed in 501us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916924.434857:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00080000:0.0:1788916924.434871:0:8068:0:(import.c:65:import_set_state_nolock()) ffff9a6e0758d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788916924.434916:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e1d3733-3759-4aa4-b321-e9a62c258363+6:2370:x1875815113436416:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 863us (2489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916924.434926:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000001:00100000:3.0:1788916924.520642:0:5814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3e1d3733-3759-4aa4-b321-e9a62c258363 00000001:00100000:1.0:1788916925.027595:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3e1d3733-3759-4aa4-b321-e9a62c258363 00010000:00010000:3.0:1788916925.217694:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916926.239533:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916927.264632:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916928.031439:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140733568:0@lo:400:kworker.0 00000100:00100000:0.0:1788916928.031513:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916928.031582:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788916928.031588:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140733440:0@lo:400:kworker.0 00000100:00100000:0.0:1788916928.031610:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916928.031625:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140733952:0@lo:400:kworker.0 00000100:00100000:0.0:1788916928.031656:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916928.031693:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140733568 00000100:00100000:0.0:1788916928.031712:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140733568 00000100:00100000:0.0:1788916928.031767:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140733440 00000100:00100000:0.0:1788916928.031770:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140733440 00000100:00100000:0.0:1788916928.031791:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788916928.031801:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140733568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916928.031858:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140733568:12345-0@lo:400:kworker.0 Request processed in 58us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916928.031865:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788916928.031882:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788916928.031888:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140733440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916928.031916:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140733440:12345-0@lo:400:kworker.0 Request processed in 28us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916928.031922:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788916928.031960:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788916928.031996:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140733440:0@lo:400:kworker.0 00000100:00100000:0.0:1788916928.032007:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140733568:0@lo:400:kworker.0 00000100:00100000:3.0:1788916928.032255:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140733696:0@lo:400:kworker.0 00000100:00100000:3.0:1788916928.032288:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916928.032332:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788916928.032339:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140733312:0@lo:400:kworker.0 00000100:00100000:3.0:1788916928.032368:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916928.032391:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140733824:0@lo:400:kworker.0 00000100:00100000:3.0:1788916928.032412:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916928.032438:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140733952 00000100:00100000:3.0:1788916928.032441:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140733952 00000100:00100000:3.0:1788916928.032470:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140733696 00000100:00100000:3.0:1788916928.032473:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140733696 00000100:00100000:3.0:1788916928.032491:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788916928.032497:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140733952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916928.032530:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140733952:12345-0@lo:400:kworker.0 Request processed in 34us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916928.032536:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788916928.032563:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788916928.032569:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140733696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916928.032597:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f625180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140733696:12345-0@lo:400:kworker.0 Request processed in 29us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916928.032603:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788916928.032618:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140733824 00000100:00100000:3.0:1788916928.032621:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140733824 00000100:00100000:3.0:1788916928.032642:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788916928.032648:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140733824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916928.032673:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140733824:12345-0@lo:400:kworker.0 Request processed in 25us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916928.032679:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788916928.032706:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140733312 00000100:00100000:3.0:1788916928.032716:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140733312 00000100:00100000:3.0:1788916928.032738:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788916928.032743:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140733312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916928.032773:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140733312:12345-0@lo:400:kworker.0 Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916928.032779:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:3.0:1788916928.032813:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788916928.032817:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788916928.032820:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788916928.032837:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140733312:0@lo:400:kworker.0 00000100:00100000:3.0:1788916928.032848:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140733824:0@lo:400:kworker.0 00010000:00080000:3.0:1788916928.032858:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e0821df80 x1875815140733696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916928.032868:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140733696:0@lo:400:kworker.0 00010000:00080000:3.0:1788916928.032903:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e0821c700 x1875815140733952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916928.032912:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140733952:0@lo:400:kworker.0 00010000:00010000:1.0:1788916928.288454:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916928.544877:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788916928.544903:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140734080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788916928.544969:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916928.545039:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140734080 00000100:00100000:1.0:1788916928.545046:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140734080 00000100:00100000:1.0:1788916928.545090:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788916928.545110:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140734080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788916928.545175:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916928.545221:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37308700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140734080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916928.545229:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788916928.547517:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e37308000 x1875815140734080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916928.547548:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140734080:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788916928.640843:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e1d3733-3759-4aa4-b321-e9a62c258363 00000100:00100000:1.0:1788916929.063694:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788916929.063730:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140734208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788916929.063813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916929.064214:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140734208 00000100:00100000:3.0:1788916929.064226:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140734208 00000100:00100000:3.0:1788916929.064288:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788916929.064300:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3730ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140734208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788916929.064350:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788916929.064414:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3730ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140734208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916929.064424:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788916929.064707:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e3f627b80 x1875815140734208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916929.064728:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f627b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140734208:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788916929.162967:0:10173:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1788916929.312456:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916929.928359:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916929.928391:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916929.928430:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916929.928460:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916929.928486:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916929.928516:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113436672 00000100:00100000:1.0:1788916929.928526:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113436672 00000100:00100000:1.0:1788916929.928576:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 222 00000100:00100000:1.0:1788916929.928586:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:2371:x1875815113436672:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788916929.928651:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:2371:x1875815113436672:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 67us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916929.928659:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 222 00000100:00100000:1.0:1788916929.928690:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113436800 00000100:00100000:1.0:1788916929.928693:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113436800 00000100:00100000:1.0:1788916929.928723:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113436928 00000100:00100000:1.0:1788916929.928725:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113436928 00000100:00100000:1.0:1788916929.928746:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:1.0:1788916929.928752:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2371:x1875815113436800:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788916929.928780:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37308e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2371:x1875815113436800:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 29us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916929.928787:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:1.0:1788916929.928798:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:1.0:1788916929.928803:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2371:x1875815113436928:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788916929.928835:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2371:x1875815113436928:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 32us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916929.928842:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:1.0:1788916929.928860:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113437056 00000100:00100000:1.0:1788916929.928864:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113437056 00000100:00100000:1.0:1788916929.928886:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113437184 00000100:00100000:1.0:1788916929.928889:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113437184 00000100:00100000:1.0:1788916929.928907:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:1.0:1788916929.928913:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2371:x1875815113437056:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788916929.928935:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2371:x1875815113437056:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 22us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916929.928943:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:1.0:1788916929.928952:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:1.0:1788916929.928957:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3730bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2371:x1875815113437184:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788916929.928975:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3730bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2371:x1875815113437184:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 18us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916929.928982:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00080000:1.0:1788916929.929128:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788916929.929132:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788916929.929135:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788916930.335513:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916931.359350:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916932.385524:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916933.151876:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3730a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140734336:0@lo:400:kworker.0 00000100:00100000:1.0:1788916933.151898:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3730b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140734592:0@lo:400:kworker.0 00000100:00100000:0.0:1788916933.151972:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140734464:0@lo:400:kworker.0 00000100:00100000:3.0:1788916933.152018:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37309c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140734720:0@lo:400:kworker.0 00000100:00100000:1.0:1788916933.154310:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916933.154930:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140734592 00000100:00100000:1.0:1788916933.154940:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140734592 00000100:00100000:1.0:1788916933.155024:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788916933.155036:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140734592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916933.155134:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140734592:12345-0@lo:400:kworker.0 Request processed in 102us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916933.155143:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1788916933.155196:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788916933.155242:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3730b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140734592:0@lo:400:kworker.0 00000100:00100000:1.0:1788916933.158301:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916933.158403:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3730a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140734976:0@lo:400:kworker.0 00000100:00100000:1.0:1788916933.158454:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916933.158516:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140734976 00000100:00100000:1.0:1788916933.158525:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140734976 00000100:00100000:1.0:1788916933.158602:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788916933.158812:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140734464 00000100:00100000:0.0:1788916933.158817:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140734464 00000100:00100000:0.0:1788916933.158853:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788916933.158865:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3730b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140734464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916933.158932:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3730b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140734464:12345-0@lo:400:kworker.0 Request processed in 68us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916933.158939:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788916933.159142:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140734976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916933.159205:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140734976:12345-0@lo:400:kworker.0 Request processed in 67us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916933.159212:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1788916933.159236:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788916933.159271:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140734464:0@lo:400:kworker.0 00010000:00080000:1.0:1788916933.159289:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e3730a680 x1875815140734976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916933.159300:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3730a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140734976:0@lo:400:kworker.0 00000100:00100000:3.0:1788916933.160015:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916933.160133:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788916933.160165:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3730b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140734848:0@lo:400:kworker.0 00000100:00100000:3.0:1788916933.160202:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916933.160318:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140734848 00000100:00100000:0.0:1788916933.160326:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140734848 00000100:00100000:0.0:1788916933.160390:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788916933.160399:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140734848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916933.160445:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140734848:12345-0@lo:400:kworker.0 Request processed in 48us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916933.160452:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788916933.160802:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3730b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140734848:0@lo:400:kworker.0 00000100:00100000:1.0:1788916933.160880:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140734720 00000100:00100000:1.0:1788916933.160885:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140734720 00000100:00100000:1.0:1788916933.160971:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788916933.160979:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140734720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916933.161069:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140734720:12345-0@lo:400:kworker.0 Request processed in 91us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916933.161076:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788916933.161159:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e37309c00 x1875815140734720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916933.161172:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37309c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140734720:0@lo:400:kworker.0 00000100:00080000:3.0:1788916933.161448:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788916933.161455:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788916933.162955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916933.163040:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140734336 00000100:00100000:1.0:1788916933.163063:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140734336 00000100:00100000:1.0:1788916933.163123:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788916933.163133:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140734336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916933.163453:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140734336:12345-0@lo:400:kworker.0 Request processed in 321us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916933.163462:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788916933.163573:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3730a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140734336:0@lo:400:kworker.0 00010000:00010000:0.0:1788916933.407576:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916933.663704:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3730a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140735104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788916933.663781:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916933.663861:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140735104 00000100:00100000:1.0:1788916933.663868:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140735104 00000100:00100000:1.0:1788916933.663924:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788916933.663933:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140735104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788916933.663972:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916933.664014:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140735104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916933.664022:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788916933.664077:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e3730a680 x1875815140735104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916933.664097:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3730a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140735104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788916934.176566:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f627800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140735232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788916934.176669:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916934.176706:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140735232 00000100:00100000:1.0:1788916934.176784:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140735232 00000100:00100000:1.0:1788916934.176846:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788916934.176857:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140735232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788916934.176898:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916934.176950:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140735232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916934.176958:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788916934.177057:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e3f627800 x1875815140735232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916934.177078:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f627800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140735232:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788916934.435081:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916935.050547:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916935.050591:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916935.050693:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113437312 00000100:00100000:0.0:1788916935.050705:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113437312 00000100:00100000:0.0:1788916935.050773:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 224 00000100:00100000:0.0:1788916935.050785:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:2371:x1875815113437312:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916935.050880:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:2371:x1875815113437312:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 97us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916935.050889:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 224 00000100:00100000:0.0:1788916935.050932:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113437440 00000100:00100000:0.0:1788916935.050936:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113437440 00000100:00100000:0.0:1788916935.050974:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:0.0:1788916935.050982:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2371:x1875815113437440:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916935.051017:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2371:x1875815113437440:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 36us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916935.051023:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00080000:3.0:1788916935.051270:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788916935.064046:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916935.064086:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916935.064131:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916935.064201:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113437696 00000100:00100000:1.0:1788916935.064214:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113437696 00000100:00100000:1.0:1788916935.064284:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113437824 00000100:00100000:1.0:1788916935.064287:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113437824 00000100:00100000:1.0:1788916935.064317:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:1.0:1788916935.064329:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3b1cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2372:x1875815113437696:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788916935.064423:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3b1cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2372:x1875815113437696:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 97us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916935.064432:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:1.0:1788916935.064642:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:1.0:1788916935.064650:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3730b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2372:x1875815113437824:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788916935.064682:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3730b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2372:x1875815113437824:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 34us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916935.064689:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:0.0:1788916935.064793:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113437568 00000100:00100000:0.0:1788916935.064799:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113437568 00000100:00100000:0.0:1788916935.064847:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:0.0:1788916935.064855:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3730a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2372:x1875815113437568:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916935.064886:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3730a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2372:x1875815113437568:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 33us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916935.064893:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00080000:3.0:1788916935.065057:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788916935.065063:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788916935.065065:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788916935.456249:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916936.479319:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916937.504779:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916938.277141:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140735360:0@lo:400:kworker.0 00000100:00100000:3.0:1788916938.277239:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916938.277334:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140735360 00000100:00100000:2.0:1788916938.277343:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140735360 00000100:00100000:2.0:1788916938.277404:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788916938.277416:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140735360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916938.278844:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140735488:0@lo:400:kworker.0 00000100:00100000:1.0:1788916938.283665:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916938.283726:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788916938.283739:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140735616:0@lo:400:kworker.0 00000100:00100000:1.0:1788916938.283768:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916938.284393:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140735744:0@lo:400:kworker.0 00000100:00100000:1.0:1788916938.284430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916938.284479:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140735744 00000100:00100000:1.0:1788916938.284488:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140735744 00000100:00100000:1.0:1788916938.284557:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788916938.284567:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3730bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140735744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916938.284644:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3730bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140735744:12345-0@lo:400:kworker.0 Request processed in 78us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916938.284652:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1788916938.284705:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e0821fb80 x1875815140735744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916938.284723:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140735744:0@lo:400:kworker.0 00000100:00100000:2.0:1788916938.284912:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140735360:12345-0@lo:400:kworker.0 Request processed in 7495us (7671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916938.284940:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:2.0:1788916938.285071:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788916938.285278:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140735488 00000100:00100000:2.0:1788916938.285284:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140735488 00000100:00100000:2.0:1788916938.285320:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140735616 00000100:00100000:2.0:1788916938.285323:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140735616 00000100:00100000:2.0:1788916938.285352:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788916938.285360:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140735488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916938.285407:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140735488:12345-0@lo:400:kworker.0 Request processed in 48us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916938.285414:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788916938.285426:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788916938.285432:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140735616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916938.285461:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140735616:12345-0@lo:400:kworker.0 Request processed in 29us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916938.285466:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1788916938.285484:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788916938.285508:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140735616:0@lo:400:kworker.0 00000100:00100000:2.0:1788916938.285520:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140735488:0@lo:400:kworker.0 00000100:00100000:3.0:1788916938.287109:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140735360:0@lo:400:kworker.0 00000100:00100000:0.0:1788916938.288730:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788916938.288753:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140735872:0@lo:400:kworker.0 00000100:00100000:0.0:1788916938.288947:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916938.288995:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140735872 00000100:00100000:0.0:1788916938.289002:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140735872 00000100:00100000:0.0:1788916938.289075:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788916938.289085:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140735872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916938.289137:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140735872:12345-0@lo:400:kworker.0 Request processed in 54us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916938.289159:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1788916938.289180:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788916938.289210:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140735872:0@lo:400:kworker.0 00000100:00100000:1.0:1788916938.289451:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788916938.289462:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140736000:0@lo:400:kworker.0 00000100:00100000:1.0:1788916938.289494:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916938.290138:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140736000 00000100:00100000:3.0:1788916938.290167:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140736000 00000100:00100000:3.0:1788916938.290222:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788916938.290230:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140736000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916938.290284:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140736000:12345-0@lo:400:kworker.0 Request processed in 56us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916938.290300:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788916938.290354:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e0821ea00 x1875815140736000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916938.290366:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140736000:0@lo:400:kworker.0 00000100:00080000:1.0:1788916938.290542:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788916938.531296:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916938.783521:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140736128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788916938.783600:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916938.783755:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140736128 00000100:00100000:2.0:1788916938.783764:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140736128 00000100:00100000:2.0:1788916938.783866:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788916938.783877:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140736128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788916938.783916:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788916938.783974:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140736128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916938.783996:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788916938.784020:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e06f0ad80 x1875815140736128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916938.784041:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140736128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788916939.298161:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788916939.298195:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140736256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788916939.298292:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916939.298403:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140736256 00000100:00100000:3.0:1788916939.298415:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140736256 00000100:00100000:3.0:1788916939.298482:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788916939.298494:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140736256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788916939.298543:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788916939.298614:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140736256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916939.298622:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788916939.298677:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e3f627480 x1875815140736256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916939.298700:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140736256:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788916939.552345:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916940.172892:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916940.172936:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916940.172957:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113438080 00000100:00100000:3.0:1788916940.172969:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113438080 00000100:00100000:0.0:1788916940.172982:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916940.173044:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916940.173103:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113438336 00000100:00100000:1.0:1788916940.173107:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113438336 00000100:00100000:3.0:1788916940.173111:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113438208 00000100:00100000:3.0:1788916940.173116:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113438208 00000100:00080000:2.0:1788916940.173168:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788916940.173174:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788916940.173212:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916940.173217:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:2.0:1788916940.173233:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2373:x1875815113438080:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916940.173237:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113437952 00000100:00100000:0.0:1788916940.173241:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113437952 00000100:00100000:0.0:1788916940.173271:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 226 00000100:00100000:0.0:1788916940.173280:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+13:2373:x1875815113437952:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788916940.173326:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2373:x1875815113438080:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 96us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916940.173332:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+13:2373:x1875815113437952:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 52us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916940.173344:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:0.0:1788916940.173344:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 226 00000100:00100000:0.0:1788916940.173390:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113438464 00000100:00100000:0.0:1788916940.173392:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113438464 00000100:00100000:0.0:1788916940.173422:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:0.0:1788916940.173426:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2373:x1875815113438464:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916940.173445:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2373:x1875815113438464:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 19us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916940.173449:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00080000:2.0:1788916940.173824:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788916940.177020:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:1.0:1788916940.177037:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2373:x1875815113438336:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788916940.177041:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:3.0:1788916940.177054:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2373:x1875815113438208:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788916940.177124:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2373:x1875815113438208:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 73us (4078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916940.177178:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:1.0:1788916940.177405:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2373:x1875815113438336:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 373us (4469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916940.177418:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 47 00010000:00010000:2.0:1788916940.580484:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916941.599491:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916942.630205:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916943.391411:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f627100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140736768:0@lo:400:kworker.0 00000100:00100000:2.0:1788916943.391529:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140736512:0@lo:400:kworker.0 00000100:00100000:2.0:1788916943.391598:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916943.391668:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140737024:0@lo:400:kworker.0 00000100:00100000:2.0:1788916943.391695:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916943.391730:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788916943.391736:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140736640:0@lo:400:kworker.0 00000100:00100000:2.0:1788916943.391756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916943.391788:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140737024 00000100:00100000:2.0:1788916943.391796:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140737024 00000100:00100000:2.0:1788916943.391860:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788916943.391869:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140737024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916943.391923:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140737024:12345-0@lo:400:kworker.0 Request processed in 55us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916943.391930:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788916943.391982:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140736512 00000100:00100000:2.0:1788916943.391986:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140736512 00000100:00100000:2.0:1788916943.392008:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140736640 00000100:00100000:2.0:1788916943.392010:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140736640 00000100:00100000:2.0:1788916943.392030:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788916943.392036:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140736512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916943.392066:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140736512:12345-0@lo:400:kworker.0 Request processed in 31us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916943.392073:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788916943.392084:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788916943.392089:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140736640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916943.392112:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140736640:12345-0@lo:400:kworker.0 Request processed in 23us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916943.392118:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788916943.392132:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788916943.392136:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788916943.392199:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140736640:0@lo:400:kworker.0 00000100:00100000:2.0:1788916943.392210:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140736512:0@lo:400:kworker.0 00010000:00080000:2.0:1788916943.392221:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e3f626d80 x1875815140737024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916943.392232:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f626d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140737024:0@lo:400:kworker.0 00000100:00100000:2.0:1788916943.392286:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916943.392311:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788916943.392318:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140736384:0@lo:400:kworker.0 00000100:00100000:2.0:1788916943.392344:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916943.392364:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140736896:0@lo:400:kworker.0 00000100:00100000:2.0:1788916943.392392:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916943.392413:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140736768 00000100:00100000:2.0:1788916943.392416:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140736768 00000100:00100000:2.0:1788916943.392446:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788916943.392452:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140736768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916943.392484:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140736768:12345-0@lo:400:kworker.0 Request processed in 31us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916943.392490:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788916943.392506:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140736384 00000100:00100000:2.0:1788916943.392509:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140736384 00000100:00100000:2.0:1788916943.392530:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788916943.392536:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140736384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916943.392563:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140736384:12345-0@lo:400:kworker.0 Request processed in 26us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916943.392569:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:2.0:1788916943.392596:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788916943.392602:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140736896 00000100:00100000:2.0:1788916943.392605:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140736896 00000100:00100000:2.0:1788916943.392627:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788916943.392634:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140736896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916943.392661:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140736896:12345-0@lo:400:kworker.0 Request processed in 27us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916943.392667:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788916943.392681:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788916943.392696:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140736384:0@lo:400:kworker.0 00000100:00100000:2.0:1788916943.392706:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140736896:0@lo:400:kworker.0 00010000:00080000:2.0:1788916943.392724:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e3f627100 x1875815140736768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916943.392734:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f627100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140736768:0@lo:400:kworker.0 00000001:02000400:1.0:1788916943.527428:0:10875:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788916943.647409:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916943.903549:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788916943.903576:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140737152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788916943.903655:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916943.903677:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140737152 00000100:00100000:3.0:1788916943.903688:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140737152 00000100:00100000:3.0:1788916943.903754:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788916943.903765:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140737152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788916943.903814:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788916943.903874:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140737152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916943.903882:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788916943.903992:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e06f09500 x1875815140737152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916943.904011:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140737152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788916944.415388:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140737280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788916944.415465:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916944.415765:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140737280 00000100:00100000:1.0:1788916944.415775:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140737280 00000100:00100000:1.0:1788916944.415892:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788916944.415904:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140737280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788916944.415960:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916944.419743:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140737280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3827us (4261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916944.419761:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788916944.420499:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e3f625180 x1875815140737280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916944.420528:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f625180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140737280:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788916944.673578:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916945.291716:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916945.291749:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916945.291847:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916945.291958:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113438592 00000100:00100000:1.0:1788916945.291969:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113438592 00000100:00100000:1.0:1788916945.292024:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 228 00000100:00100000:1.0:1788916945.292031:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:2372:x1875815113438592:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788916945.292096:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:2372:x1875815113438592:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 66us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916945.292102:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 228 00000100:00100000:2.0:1788916945.292176:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113438720 00000100:00100000:2.0:1788916945.292180:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113438720 00000100:00100000:2.0:1788916945.292214:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113438848 00000100:00100000:2.0:1788916945.292216:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113438848 00000100:00100000:2.0:1788916945.292229:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00100000:2.0:1788916945.292234:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2372:x1875815113438720:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788916945.292259:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2372:x1875815113438720:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916945.292264:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00100000:2.0:1788916945.292272:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:2.0:1788916945.292290:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2372:x1875815113438848:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788916945.292305:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2372:x1875815113438848:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 16us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916945.292309:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00080000:1.0:1788916945.292497:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788916945.302315:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916945.302351:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916945.302430:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113438976 00000100:00100000:3.0:1788916945.302441:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113438976 00000100:00100000:2.0:1788916945.302494:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113439104 00000100:00100000:2.0:1788916945.302500:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113439104 00000100:00100000:3.0:1788916945.302517:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:3.0:1788916945.302527:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2370:x1875815113438976:12345-192.168.202.40@tcp:9:kworker.0 00000100:00100000:2.0:1788916945.302541:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:2.0:1788916945.302552:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2370:x1875815113439104:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:3.0:1788916945.302563:0:6590:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d78a 00000020:00000080:2.0:1788916945.302571:0:6592:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d791 00000100:00080000:3.0:1788916945.302574:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9a6e3f7fa000 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1788916945.302580:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9a6e0758d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788916945.302616:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000001:00000004:2.0:1788916945.302619:0:6592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788916945.303103:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e1d3733-3759-4aa4-b321-e9a62c258363+2:2370:x1875815113438976:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 577us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916945.303108:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00080000:1.0:1788916945.303120:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788916945.303126:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788916945.303127:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916945.303134:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916945.304526:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+2:2370:x1875815113439104:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 1965us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916945.304538:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000001:00100000:1.0:1788916945.488873:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3e1d3733-3759-4aa4-b321-e9a62c258363 00000020:00000080:1.0:1788916945.488886:0:7503:0:(genops.c:907:class_export_put()) final put ffff9a6e0758c000/3e1d3733-3759-4aa4-b321-e9a62c258363 00000020:00000080:0.0:1788916945.488989:0:8:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e0758c000/3e1d3733-3759-4aa4-b321-e9a62c258363 for lustre-OST0001 00000020:00000080:0.0:1788916945.489114:0:8:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e0758d000 for lustre-OST0001 00010000:00010000:3.0:1788916945.695401:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788916945.840454:0:11024:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe205bffa0 20000000:00000080:3.0:1788916945.840474:0:11024:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6e37276800 uarg=0000000000000000 20000000:01000000:3.0:1788916945.840514:0:11024:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788916945.840525:0:11024:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788916945.840531:0:11024:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788916945.841350:0:11025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788916945.841510:0:11024:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788916945.850522:0:11024:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788916945.850568:0:11024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6e2d18e000/0x51de7f756a83d798 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.850591:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d73d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f412 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.850601:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83d74b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d744 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.850608:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e1eeab400/0x51de7f756a83d759 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d752 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.850615:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e1eeaa600/0x51de7f756a83d767 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d760 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.850623:0:11024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d77c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f44a expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.850631:0:11024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6e2d18e000/0x51de7f756a83d798 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.850674:0:11024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d77c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f44a expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.850689:0:11024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d77c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f44a expref: 12 pid: 5787 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916945.850705:0:11024:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f626300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11024:1875815140737408:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788916945.850836:0:11024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e1eeaa600/0x51de7f756a83d767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d760 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.850846:0:11024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e1eeaa600/0x51de7f756a83d767 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d760 expref: 18 pid: 5784 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916945.850856:0:11024:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f627800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11024:1875815140737536:0@lo:104: 00000100:00100000:3.0:1788916945.850900:0:11024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788916945.850953:0:11024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e1eeab400/0x51de7f756a83d759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d752 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.850962:0:11024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e1eeab400/0x51de7f756a83d759 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d752 expref: 18 pid: 5784 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916945.850971:0:11024:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f625180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11024:1875815140737664:0@lo:104: 00000100:00100000:3.0:1788916945.850993:0:11024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916945.851035:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140737536 00000100:00100000:3.0:1788916945.851044:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140737536 00000100:00100000:3.0:1788916945.851100:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140737664 00000100:00100000:3.0:1788916945.851104:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140737664 00000100:00100000:3.0:1788916945.851122:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788916945.851131:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f627b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+4:11024:x1875815140737536:12345-0@lo:104: 00010000:00010000:3.0:1788916945.851186:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa400/0x51de7f756a83d760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d767 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851240:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788916945.851246:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f627b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+4:11024:x1875815140737536:12345-0@lo:104: Request processed in 116us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916945.851254:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788916945.851281:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788916945.851288:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f627100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+3:11024:x1875815140737664:12345-0@lo:104: 00010000:00010000:3.0:1788916945.851296:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83d752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d759 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851329:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788916945.851335:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f627100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+3:11024:x1875815140737664:12345-0@lo:104: Request processed in 48us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916945.851342:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788916945.851360:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788916945.851367:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa400/0x51de7f756a83d760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d767 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851376:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaa400 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1788916945.851381:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa400/0x51de7f756a83d760 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d767 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851390:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa400/0x51de7f756a83d760 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d767 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788916945.851399:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa400/0x51de7f756a83d760 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d767 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788916945.851405:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788916945.851431:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa400/0x51de7f756a83d760 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d767 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851438:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788916945.851458:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa400/0x51de7f756a83d760 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d767 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851476:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa400/0x51de7f756a83d760 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d767 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851489:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788916945.851493:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83d752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d759 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851499:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab200 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1788916945.851502:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83d752 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d759 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851509:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83d752 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d759 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788916945.851515:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83d752 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d759 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788916945.851521:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788916945.851536:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83d752 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d759 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851542:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788916945.851554:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83d752 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d759 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851560:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83d752 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d759 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851569:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916945.851576:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916945.851578:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916945.851584:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916945.851609:0:11024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83d74b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d744 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851619:0:11024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83d74b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d744 expref: 18 pid: 5787 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916945.851630:0:11024:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f626d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11024:1875815140738048:0@lo:104: 00000100:00100000:3.0:1788916945.851658:0:11024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916945.851676:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140738048 00000100:00100000:3.0:1788916945.851680:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140738048 00000100:00100000:3.0:1788916945.851696:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788916945.851702:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f625500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+3:11024:x1875815140738048:12345-0@lo:104: 00010000:00010000:3.0:1788916945.851710:0:5775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaae00/0x51de7f756a83d744 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d74b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851742:0:5775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788916945.851748:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f625500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4933373a-b540-4420-bf34-9071e19d7373+3:11024:x1875815140738048:12345-0@lo:104: Request processed in 46us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916945.851754:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788916945.851769:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788916945.851773:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaae00/0x51de7f756a83d744 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d74b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851780:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaae00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1788916945.851783:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaae00/0x51de7f756a83d744 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d74b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851803:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaae00/0x51de7f756a83d744 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d74b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788916945.851811:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaae00/0x51de7f756a83d744 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d74b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788916945.851816:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788916945.851832:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaae00/0x51de7f756a83d744 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d74b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851838:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788916945.851845:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaae00/0x51de7f756a83d744 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d74b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851852:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaae00/0x51de7f756a83d744 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d74b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851865:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916945.851867:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916945.851869:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916945.851893:0:11024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d73d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f412 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916945.851903:0:11024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d73d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f412 expref: 12 pid: 5787 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916945.851912:0:11024:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c992a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11024:1875815140738304:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788916945.851962:0:11024:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06eb6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788916945.851984:0:11024:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f627800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11024:1875815140737536:0@lo:104: 00000100:00100000:3.0:1788916945.852001:0:11024:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f625180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11024:1875815140737664:0@lo:104: 00000100:00100000:3.0:1788916945.852009:0:11024:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f626d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11024:1875815140738048:0@lo:104: 00000100:00100000:2.0:1788916945.852100:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788916945.852113:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140737792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788916945.852182:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916945.852211:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140737920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788916945.852237:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916945.852257:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788916945.852264:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140738176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788916945.852301:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916945.852333:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140737792 00000100:00100000:2.0:1788916945.852337:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140737792 00010000:00010000:2.0:1788916945.852361:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e1eeaa600/0x51de7f756a83d767 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d760 expref: 19 pid: 5784 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916945.852392:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140737920 00000100:00100000:2.0:1788916945.852396:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140737920 00010000:00010000:2.0:1788916945.852408:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e1eeab400/0x51de7f756a83d759 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d752 expref: 20 pid: 5784 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916945.852418:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140738176 00000100:00100000:2.0:1788916945.852421:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140738176 00010000:00010000:2.0:1788916945.852429:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83d74b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d744 expref: 21 pid: 5787 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916945.852442:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788916945.852448:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e08220850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4933373a-b540-4420-bf34-9071e19d7373+21:3304:x1875815140737792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788916945.852460:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916945.852466:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e1eeaa600/0x51de7f756a83d767 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d760 expref: 21 pid: 5784 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916945.852474:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e1eeaa600/0x51de7f756a83d767 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d760 expref: 21 pid: 5784 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916945.852489:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e1eeaa600/0x51de7f756a83d767 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d760 expref: 21 pid: 5784 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916945.852500:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788916945.852526:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e08220850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4933373a-b540-4420-bf34-9071e19d7373+20:3304:x1875815140737792:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916945.852533:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788916945.852576:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788916945.852582:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4933373a-b540-4420-bf34-9071e19d7373+19:3306:x1875815140737920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788916945.852596:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916945.852601:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e1eeab400/0x51de7f756a83d759 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d752 expref: 19 pid: 5784 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916945.852609:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e1eeab400/0x51de7f756a83d759 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d752 expref: 19 pid: 5784 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916945.852619:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e1eeab400/0x51de7f756a83d759 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d752 expref: 19 pid: 5784 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916945.852628:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788916945.852657:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4933373a-b540-4420-bf34-9071e19d7373+18:3306:x1875815140737920:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916945.852663:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788916945.852675:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788916945.852681:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4933373a-b540-4420-bf34-9071e19d7373+17:3306:x1875815140738176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788916945.852688:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916945.852692:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83d74b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d744 expref: 17 pid: 5787 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916945.852699:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83d74b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d744 expref: 17 pid: 5787 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916945.852707:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83d74b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d744 expref: 17 pid: 5787 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916945.852715:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788916945.852735:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4933373a-b540-4420-bf34-9071e19d7373+16:3306:x1875815140738176:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916945.852749:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788916945.852781:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f624000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140737792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788916945.852824:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f624380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140738176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788916945.852837:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f627480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140737920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788916945.855860:0:11024:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f626300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11024:1875815140737408:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788916945.855880:0:11024:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c992a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11024:1875815140738304:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788916945.855916:0:11024:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6e2d18e000/0x51de7f756a83d798 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916945.858037:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916945.858086:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916945.858126:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113439360 00000100:00100000:1.0:1788916945.858133:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113439360 00000100:00100000:0.0:1788916945.858175:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113439232 00000100:00100000:0.0:1788916945.858180:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113439232 00010000:00010000:1.0:1788916945.858184:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d73d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f412 expref: 13 pid: 5787 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916945.858204:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d77c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f44a expref: 14 pid: 5787 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916945.858230:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:0.0:1788916945.858238:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:1.0:1788916945.858239:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c992a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f367f55b-9b55-442e-a009-d3d404e176a2+14:2374:x1875815113439360:12345-192.168.202.40@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788916945.858254:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c990700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f367f55b-9b55-442e-a009-d3d404e176a2+14:2373:x1875815113439232:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788916945.858255:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916945.858261:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d73d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f412 expref: 14 pid: 5787 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916945.858270:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d73d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f412 expref: 14 pid: 5787 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916945.858280:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916945.858286:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d73d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f412 expref: 14 pid: 5787 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916945.858289:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d77c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f44a expref: 14 pid: 5787 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916945.858301:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788916945.858306:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d77c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f44a expref: 13 pid: 5787 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916945.858320:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d77c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f44a expref: 13 pid: 5787 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916945.858334:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6e2d18e000/0x51de7f756a83d798 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916945.858345:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c992a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f367f55b-9b55-442e-a009-d3d404e176a2+12:2374:x1875815113439360:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 109us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916945.858350:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00010000:00010000:0.0:1788916945.858355:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e2d18e000/0x51de7f756a83d798 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916945.858372:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e2d18e000/0x51de7f756a83d798 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916945.858381:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e2d18e000/0x51de7f756a83d798 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916945.858389:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6e2d18e000/0x51de7f756a83d798 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916945.858397:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6e2d18e000/0x51de7f756a83d798 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916945.858404:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e000 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788916945.858410:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6e2d18e000/0x51de7f756a83d798 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916945.858430:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6e2d18e000/0x51de7f756a83d798 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916945.858454:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6e2d18e000/0x51de7f756a83d798 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916945.858465:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788916945.858492:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c990700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f367f55b-9b55-442e-a009-d3d404e176a2+11:2373:x1875815113439232:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 242us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916945.858499:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00010000:00010000:1.0:1788916945.858790:0:11024:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6e2d18e000/0x51de7f756a83d798 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916945.858797:0:11024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6e2d18e000/0x51de7f756a83d798 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916945.858801:0:11024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e2d18e000/0x51de7f756a83d798 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916946.719735:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916947.471467:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916947.471575:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113439488 00000100:00100000:0.0:1788916947.471585:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113439488 00000100:00100000:0.0:1788916947.471700:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 229 00000100:00100000:0.0:1788916947.471712:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+11:5593:x1875815113439488:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788916947.471732:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916947.471755:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d79f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f474 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.471785:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d79f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f474 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.471796:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d79f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f474 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.471805:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2e00, rc 0) 00000100:00100000:0.0:1788916947.471871:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+12:5593:x1875815113439488:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 161us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916947.471893:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 229 00000100:00100000:1.0:1788916947.482230:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916947.482271:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113439616 00000100:00100000:1.0:1788916947.482290:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113439616 00000100:00100000:1.0:1788916947.482338:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 230 00000100:00100000:1.0:1788916947.482347:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+12:5593:x1875815113439616:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788916947.482616:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+12:5593:x1875815113439616:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 269us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916947.482625:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 230 00000100:00100000:3.0:1788916947.486125:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916947.486202:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113439744 00000100:00100000:1.0:1788916947.486214:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113439744 00000100:00100000:1.0:1788916947.486289:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 231 00000100:00100000:1.0:1788916947.486300:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+12:5593:x1875815113439744:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788916947.486550:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+12:5593:x1875815113439744:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 252us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916947.486558:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 231 00000100:00100000:1.0:1788916947.491189:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916947.493191:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113439872 00000100:00100000:3.0:1788916947.493205:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113439872 00000100:00100000:3.0:1788916947.493275:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 232 00000100:00100000:3.0:1788916947.493287:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+12:5593:x1875815113439872:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788916947.493306:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916947.493328:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e2d18ec00/0x51de7f756a83d7a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f47b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916947.493357:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e2d18ec00/0x51de7f756a83d7a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f47b expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916947.493367:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e2d18ec00/0x51de7f756a83d7a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f47b expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916947.493377:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18ec00, rc 0) 00000100:00100000:3.0:1788916947.493448:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:5593:x1875815113439872:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 163us (2268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916947.493462:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 232 00000100:00100000:1.0:1788916947.495112:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916947.495738:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113440000 00000100:00100000:3.0:1788916947.495749:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113440000 00000100:00100000:3.0:1788916947.495810:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 233 00000100:00100000:3.0:1788916947.495820:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:5593:x1875815113440000:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788916947.496142:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:5593:x1875815113440000:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 323us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916947.496170:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 233 00000100:00100000:3.0:1788916947.506878:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916947.506965:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113440128 00000100:00100000:2.0:1788916947.506976:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113440128 00000100:00100000:2.0:1788916947.507039:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 234 00000100:00100000:2.0:1788916947.507049:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:5593:x1875815113440128:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788916947.507298:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:5593:x1875815113440128:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 249us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916947.507307:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 234 00010000:00010000:3.0:1788916947.744625:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788916947.871326:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788916947.871335:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e3f439800 from 7 10000000:01000000:3.0:1788916947.871340:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788916947.871392:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18fa00/0x51de7f756a83d7ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916947.871406:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18fa00/0x51de7f756a83d7ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916947.871418:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18fa00/0x51de7f756a83d7ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916947.871450:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c990000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140738432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788916947.871525:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916947.871584:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06eb6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788916947.871657:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140738432 00000100:00100000:0.0:1788916947.871665:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140738432 00000100:00100000:0.0:1788916947.871721:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788916947.871731:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+16:5789:x1875815140738432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788916947.871746:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916947.871761:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee2c00/0x51de7f756a83d7b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d7ad expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.871784:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee2c00/0x51de7f756a83d7b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d7ad expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.871796:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee2c00/0x51de7f756a83d7b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d7ad expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.871805:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2c00, rc 0) 00000100:00100000:0.0:1788916947.871846:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140738432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916947.871853:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788916947.871899:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c990000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140738432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788916947.871913:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18fa00/0x51de7f756a83d7ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d7b4 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.871932:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18fa00/0x51de7f756a83d7ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d7b4 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916947.871991:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140738560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788916947.872031:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916947.872044:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b16b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788916947.872105:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140738560 00000100:00100000:3.0:1788916947.872109:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140738560 00000100:00100000:3.0:1788916947.872140:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788916947.872171:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140738560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788916947.872418:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140738560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916947.872425:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788916947.872511:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140738560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788916947.872543:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140738688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788916947.872577:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916947.872607:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b16b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788916947.872656:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140738688 00000100:00100000:3.0:1788916947.872660:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140738688 00000100:00100000:3.0:1788916947.872689:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788916947.872695:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140738688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788916947.872832:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140738688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916947.872839:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788916947.872924:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140738688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788916947.873779:0:11156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788916947.874174:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788916947.874196:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788916947.874207:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18fa00/0x51de7f756a83d7ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d7b4 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916947.874218:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18fa00/0x51de7f756a83d7ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d7b4 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788916947.874229:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788916947.874231:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e2c984800 from 7 10000000:01000000:3.0:1788916947.874234:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788916947.874267:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d7bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916947.874275:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d7bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916947.874285:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d7bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916947.874312:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140738816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788916947.874361:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916947.874399:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06eb6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916947.874484:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140738816 00000100:00100000:0.0:1788916947.874490:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140738816 00000100:00100000:0.0:1788916947.874532:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788916947.874540:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140738816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788916947.874552:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916947.874565:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d7c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d7bb expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.874586:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d7c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d7bb expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.874595:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d7c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d7bb expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.874603:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3400, rc 0) 00000100:00100000:0.0:1788916947.874639:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140738816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916947.874646:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788916947.874684:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140738816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788916947.874703:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d7bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d7c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.874711:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d7bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d7c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916947.874756:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140738944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788916947.874782:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916947.874795:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b16bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788916947.874808:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140738944 00000100:00100000:0.0:1788916947.874811:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140738944 00000100:00100000:0.0:1788916947.874833:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788916947.874840:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140738944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788916947.875091:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140738944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916947.875098:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788916947.875127:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140738944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788916947.875175:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140739072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788916947.875210:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916947.875223:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b16bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788916947.875238:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140739072 00000100:00100000:0.0:1788916947.875241:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140739072 00000100:00100000:0.0:1788916947.875260:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788916947.875266:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140739072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788916947.875396:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140739072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916947.875413:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788916947.875450:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140739072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788916947.876084:0:11157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788916947.876124:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788916947.876162:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788916947.876170:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d7bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d7c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.876180:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d7bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d7c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788916947.876189:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788916947.876192:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e171d2800 from 7 10000000:01000000:0.0:1788916947.876194:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788916947.876215:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83d7c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.876222:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83d7c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.876231:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83d7c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916947.876245:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140739200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788916947.876274:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916947.876292:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b16b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788916947.876307:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140739200 00000100:00100000:0.0:1788916947.876311:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140739200 00000100:00100000:0.0:1788916947.876334:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788916947.876349:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0325c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140739200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788916947.876358:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916947.876367:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d7d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d7c9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.876384:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d7d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d7c9 expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.876394:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d7d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d7c9 expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.876402:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2800, rc 0) 00000100:00100000:0.0:1788916947.876432:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0325c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140739200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916947.876438:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788916947.876472:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140739200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788916947.876484:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83d7c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d7d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.876493:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83d7c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d7d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916947.876530:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140739328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788916947.876555:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916947.876568:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b16b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788916947.876578:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140739328 00000100:00100000:0.0:1788916947.876582:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140739328 00000100:00100000:0.0:1788916947.876602:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788916947.876615:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0325e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140739328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788916947.876784:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0325e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140739328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916947.876790:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788916947.876818:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140739328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788916947.876842:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0821d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140739456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788916947.876876:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916947.876888:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b16b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788916947.876899:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140739456 00000100:00100000:0.0:1788916947.876902:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140739456 00000100:00100000:0.0:1788916947.876932:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788916947.876939:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0dd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140739456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788916947.877053:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0dd40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140739456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916947.877060:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788916947.877096:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0821d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140739456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788916947.877771:0:11158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788916947.877805:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788916947.877818:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788916947.877825:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83d7c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d7d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916947.877834:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83d7c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d7d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916948.511447:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140739712:0@lo:400:kworker.0 00000100:00100000:3.0:1788916948.511534:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916948.511589:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140740224:0@lo:400:kworker.0 00000100:00100000:3.0:1788916948.511616:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916948.511648:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788916948.511655:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140739584:0@lo:400:kworker.0 00000100:00100000:3.0:1788916948.511682:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916948.511702:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140740096:0@lo:400:kworker.0 00000100:00100000:3.0:1788916948.511723:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916948.511747:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140739840:0@lo:400:kworker.0 00000100:00100000:3.0:1788916948.511769:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916948.511785:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788916948.511790:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140739968:0@lo:400:kworker.0 00000100:00100000:3.0:1788916948.511817:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916948.511845:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140739712 00000100:00100000:3.0:1788916948.511853:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140739712 00000100:00100000:3.0:1788916948.511895:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140740096 00000100:00100000:3.0:1788916948.511898:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140740096 00000100:00100000:3.0:1788916948.511930:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140739840 00000100:00100000:3.0:1788916948.511934:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140739840 00000100:00100000:3.0:1788916948.511950:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788916948.511959:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140739712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916948.512018:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140739712:12345-0@lo:400:kworker.0 Request processed in 59us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916948.512026:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788916948.512042:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788916948.512049:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140740096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916948.512074:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140740096:12345-0@lo:400:kworker.0 Request processed in 26us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916948.512079:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788916948.512090:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788916948.512096:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140739840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916948.512124:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140739840:12345-0@lo:400:kworker.0 Request processed in 29us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916948.512130:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788916948.512167:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140740224 00000100:00100000:3.0:1788916948.512171:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140740224 00000100:00100000:3.0:1788916948.512196:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140739968 00000100:00100000:3.0:1788916948.512199:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140739968 00000100:00100000:3.0:1788916948.512217:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788916948.512223:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140740224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916948.512254:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140740224:12345-0@lo:400:kworker.0 Request processed in 31us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916948.512261:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788916948.512271:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788916948.512277:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140739968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916948.512302:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140739968:12345-0@lo:400:kworker.0 Request processed in 26us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916948.512317:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788916948.512334:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140739584 00000100:00100000:3.0:1788916948.512337:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140739584 00000100:00100000:3.0:1788916948.512360:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788916948.512366:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140739584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916948.512393:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140739584:12345-0@lo:400:kworker.0 Request processed in 28us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916948.512399:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00010000:00080000:3.0:1788916948.512461:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2c993800 x1875815140739968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916948.512476:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140739968:0@lo:400:kworker.0 00000100:00100000:3.0:1788916948.512486:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140739840:0@lo:400:kworker.0 00000100:00100000:3.0:1788916948.512516:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140739584:0@lo:400:kworker.0 00000100:00100000:3.0:1788916948.512525:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140740096:0@lo:400:kworker.0 00000100:00100000:3.0:1788916948.512534:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140739712:0@lo:400:kworker.0 00010000:00080000:3.0:1788916948.512543:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2c990000 x1875815140740224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916948.512551:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140740224:0@lo:400:kworker.0 00000100:00080000:1.0:1788916948.512815:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788916948.512820:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788916948.512823:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788916948.767459:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788916948.912103:0:11222:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788916949.024443:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788916949.024470:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140740352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788916949.024572:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916949.024866:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140740352 00000100:00100000:3.0:1788916949.024875:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140740352 00000100:00100000:3.0:1788916949.024939:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788916949.024950:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140740352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788916949.024990:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788916949.025039:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140740352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916949.025047:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788916949.025112:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6d01a82a00 x1875815140740352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916949.025132:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140740352:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788916949.071466:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e1d3733-3759-4aa4-b321-e9a62c258363 00000020:00000080:0.0:1788916949.071489:0:6617:0:(genops.c:907:class_export_put()) final put ffff9a6e3f7fc800/3e1d3733-3759-4aa4-b321-e9a62c258363 00000020:00000080:0.0:1788916949.071532:0:8:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e3f7fc800/3e1d3733-3759-4aa4-b321-e9a62c258363 for lustre-OST0000 00000020:00000080:0.0:1788916949.071572:0:8:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e3f7fa000 for lustre-OST0000 00000100:00100000:2.0:1788916949.535403:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788916949.535472:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140740480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788916949.535556:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916949.535781:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140740480 00000100:00100000:3.0:1788916949.535790:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140740480 00000100:00100000:3.0:1788916949.535879:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788916949.535889:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140740480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788916949.535948:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788916949.536027:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140740480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916949.536033:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788916949.536082:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6d01a82a00 x1875815140740480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916949.536097:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140740480:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788916949.791357:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916950.407584:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916950.407681:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916950.407720:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916950.407762:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113440256 00000100:00100000:2.0:1788916950.407772:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113440256 00000100:00100000:2.0:1788916950.407835:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 245 00000100:00100000:2.0:1788916950.407846:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:2374:x1875815113440256:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788916950.407946:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:2374:x1875815113440256:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 101us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916950.407969:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 245 00000100:00100000:3.0:1788916950.408653:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113440384 00000100:00100000:3.0:1788916950.408660:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113440384 00000100:00080000:1.0:1788916950.408763:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788916950.408801:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113440512 00000100:00100000:3.0:1788916950.408805:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113440512 00000100:00080000:1.0:1788916950.408858:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788916950.408903:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 90 00000100:00100000:2.0:1788916950.408913:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3730aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2374:x1875815113440384:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788916950.408971:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3730aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2374:x1875815113440384:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 59us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916950.408978:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 90 00000100:00100000:2.0:1788916950.408995:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 91 00000100:00100000:2.0:1788916950.409001:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3730a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2374:x1875815113440512:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788916950.409024:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3730a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2374:x1875815113440512:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916950.409031:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 91 00010000:00010000:3.0:1788916950.816257:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788916951.529280:0:11322:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:22:29 (1788916949) === 00000100:00100000:0.0:1788916951.688986:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916951.689043:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916951.689118:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113440640 00000100:00100000:3.0:1788916951.689179:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113440640 00000100:00100000:1.0:1788916951.689218:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113440768 00000100:00100000:1.0:1788916951.689222:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113440768 00000100:00100000:3.0:1788916951.689242:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:1.0:1788916951.689252:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:3.0:1788916951.689253:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2371:x1875815113440640:12345-192.168.202.40@tcp:41:mkdir.0 00000100:00100000:1.0:1788916951.689258:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:9702:x1875815113440768:12345-192.168.202.40@tcp:700:mkdir.0 00000004:00000024:3.0:1788916951.689297:0:8069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788916951.689334:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:9702:x1875815113440768:12345-192.168.202.40@tcp:700:mkdir.0 Request processed in 76us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916951.689340:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2371:x1875815113440640:12345-192.168.202.40@tcp:41:mkdir.0 Request processed in 90us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916951.689343:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:3.0:1788916951.689346:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:1.0:1788916951.692718:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916951.692800:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113441024 00000100:00100000:2.0:1788916951.692811:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113441024 00000100:00100000:2.0:1788916951.692871:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:2.0:1788916951.692892:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:9702:x1875815113441024:12345-192.168.202.40@tcp:36:mkdir.0 00010000:00010000:2.0:1788916951.692951:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916951.694357:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d6b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3fd expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.694381:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02f3c700) 00010000:00010000:2.0:1788916951.694408:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788916951.696325:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d7d7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.696349:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d7d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.696369:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d7d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.697722:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d7de lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.697742:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d7de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.697752:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d7de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916951.702367:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788916951.702385:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d7d7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.702393:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d7d7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.702399:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d7d7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.702403:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fc000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916951.702406:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d7d7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.702410:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d7d7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.702424:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02f3c600) 00010000:00010000:2.0:1788916951.702427:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916951.702435:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d7d7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.702439:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d7d7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788916951.702459:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ee3e70fc reply state 0000000064220d44 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d7de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916951.702466:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788916951.702574:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:9702:x1875815113441024:12345-192.168.202.40@tcp:36:mkdir.0 Request processed in 9688us (9859us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788916951.702584:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00010000:00010000:2.0:1788916951.710665:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d7de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.710684:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d7de lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.710692:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d7de lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.710698:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fd800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916951.710702:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d7de lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.710711:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d7de lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.710729:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a6e02f3c800) 00010000:00010000:2.0:1788916951.710732:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916951.710736:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d7de lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.710758:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d7de lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916951.714498:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916951.714592:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113441152 00000100:00100000:3.0:1788916951.714602:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113441152 00000100:00100000:3.0:1788916951.714668:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:3.0:1788916951.714679:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3730b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:9704:x1875815113441152:12345-192.168.202.40@tcp:101:chmod.0 00010000:00010000:3.0:1788916951.714703:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916951.714734:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83d7e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f482 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.714800:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d7ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.714813:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d7ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.714825:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d7ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916951.714890:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788916951.714894:0:8069:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788916951.714938:0:8069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d7ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.714965:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83d7e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f482 expref: 8 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.714997:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d7ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f482 expref: 7 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.715006:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:3.0:1788916951.715009:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788916951.715012:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e200, rc 0) 00000100:00100000:3.0:1788916951.715079:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3730b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:9704:x1875815113441152:12345-192.168.202.40@tcp:101:chmod.0 Request processed in 401us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916951.715087:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:1.0:1788916951.718288:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916951.718371:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113441408 00000100:00100000:3.0:1788916951.718382:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113441408 00000100:00100000:3.0:1788916951.718437:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:3.0:1788916951.718448:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:9704:x1875815113441408:12345-192.168.202.40@tcp:36:chmod.0 00010000:00010000:3.0:1788916951.718517:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916951.718541:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d7ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f482 expref: 7 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.718555:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:3.0:1788916951.718564:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788916951.718587:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83d7f3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.718600:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83d7f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.718610:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83d7f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788916951.718963:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bda432d2 reply state 00000000f8e70f54 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83d7f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916951.718974:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788916951.718989:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1788916951.719173:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37308000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:9704:x1875815113441408:12345-192.168.202.40@tcp:36:chmod.0 Request processed in 727us (894us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788916951.719180:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00010000:00010000:1.0:1788916951.720535:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83d7f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.720546:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83d7f3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.720551:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83d7f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.720555:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916951.720558:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83d7f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.720562:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83d7f3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.720573:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02cee800) 00010000:00010000:1.0:1788916951.720575:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788916951.720578:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83d7f3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.720581:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83d7f3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916951.734486:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916951.734737:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113441536 00000100:00100000:3.0:1788916951.734746:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113441536 00000100:00100000:3.0:1788916951.734841:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:3.0:1788916951.734851:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:9705:x1875815113441536:12345-192.168.202.40@tcp:101:chown.0 00010000:00010000:3.0:1788916951.734900:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916951.734929:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d7fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f489 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.735004:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83d801 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.735015:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83d801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.735023:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83d801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916951.735079:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788916951.735082:0:8069:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788916951.735112:0:8069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83d801 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.735189:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d7fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f489 expref: 9 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.735209:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83d801 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f489 expref: 8 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.735218:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:3.0:1788916951.735221:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788916951.735225:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f800, rc 0) 00000100:00100000:3.0:1788916951.735284:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a773480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:9705:x1875815113441536:12345-192.168.202.40@tcp:101:chown.0 Request processed in 435us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916951.735289:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:0.0:1788916951.736735:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916951.736806:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113441664 00000100:00100000:2.0:1788916951.736813:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113441664 00000100:00100000:2.0:1788916951.736917:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:2.0:1788916951.736928:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:9705:x1875815113441664:12345-192.168.202.40@tcp:101:chown.0 00010000:00010000:2.0:1788916951.736945:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916951.736960:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d808 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f490 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737011:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d80f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737024:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d80f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737033:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d80f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737046:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d816 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737052:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737058:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737334:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d81d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737352:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d81d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737357:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d81d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916951.737390:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788916951.737392:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788916951.737408:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d81d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737417:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d80f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737421:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d80f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737426:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d80f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737429:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fc000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916951.737432:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d80f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737437:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d80f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737445:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:2.0:1788916951.737447:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916951.737450:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d80f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737460:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d80f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737471:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737474:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d816 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737478:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d816 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737482:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fdc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916951.737484:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d816 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737490:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d816 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737498:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a6e02f3c800) 00010000:00010000:2.0:1788916951.737500:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916951.737503:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d816 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737508:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d816 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737538:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d808 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f490 expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737550:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d81d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f490 expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.737560:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6e02f3c600) 00010000:00010000:2.0:1788916951.737561:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788916951.737563:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e013fc200, rc 0) 00000100:00100000:2.0:1788916951.737647:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:9705:x1875815113441664:12345-192.168.202.40@tcp:101:chown.0 Request processed in 722us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916951.737653:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:1.0:1788916951.740108:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916951.740514:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113441920 00000100:00100000:2.0:1788916951.740524:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113441920 00000100:00100000:2.0:1788916951.740613:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:2.0:1788916951.740624:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:9705:x1875815113441920:12345-192.168.202.40@tcp:36:chown.0 00010000:00010000:2.0:1788916951.740681:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916951.740706:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d81d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f490 expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.740721:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6e02f3c600) 00010000:00010000:2.0:1788916951.740730:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788916951.740750:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d824 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.740760:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d824 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.740768:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d824 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788916951.762771:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1788916951.762827:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b1693c3c reply state 00000000a90f9348 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d824 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916951.762842:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788916951.763015:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1788916951.763119:0:5794:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788916951.763138:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a772a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:9705:x1875815113441920:12345-192.168.202.40@tcp:36:chown.0 Request processed in 22511us (23030us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788916951.763171:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00010000:00010000:1.0:1788916951.763447:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d824 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.763459:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d824 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.763467:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d824 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.763474:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fcc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916951.763616:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d824 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.763626:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d824 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.763645:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6e02f3c700) 00010000:00010000:1.0:1788916951.763648:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788916951.763653:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d824 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.763669:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d824 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916951.775399:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916951.775499:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113442048 00000100:00100000:3.0:1788916951.775510:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113442048 00000100:00100000:3.0:1788916951.775574:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:3.0:1788916951.775585:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:9706:x1875815113442048:12345-192.168.202.40@tcp:101:touch.500 00010000:00010000:3.0:1788916951.775613:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916951.775635:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d82b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f497 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788916951.777982:0:5793:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2288us 00010000:00010000:3.0:1788916951.789907:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d832 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.789936:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d832 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.789965:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d832 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.789985:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d839 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.789993:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d839 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.789998:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d839 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.790622:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83d840 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.790635:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83d840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.790642:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83d840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916951.790729:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788916951.790735:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788916951.790839:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83d840 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.790854:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d832 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.790861:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d832 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.790878:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d832 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.791758:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18fc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916951.791764:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d832 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.791772:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d832 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.791786:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:3.0:1788916951.791790:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916951.791794:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d832 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.791801:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d832 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.791816:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d839 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.791823:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d839 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.791828:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d839 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.791833:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916951.791835:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d839 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.791853:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d839 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.791862:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a6e02cee300) 00010000:00010000:3.0:1788916951.791864:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916951.791867:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d839 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.791873:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d839 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.792336:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d82b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f497 expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.792353:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83d840 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f497 expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.792361:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6e02ceec00) 00010000:00010000:3.0:1788916951.792364:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788916951.792366:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f600, rc 0) 00000100:00100000:3.0:1788916951.792446:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a772300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:9706:x1875815113442048:12345-192.168.202.40@tcp:101:touch.500 Request processed in 16860us (17055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916951.792455:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:1.0:1788916951.795016:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916951.795105:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113442304 00000100:00100000:3.0:1788916951.795117:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113442304 00000100:00100000:3.0:1788916951.795357:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1788916951.795367:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:9706:x1875815113442304:12345-192.168.202.40@tcp:101:touch.500 00010000:00010000:3.0:1788916951.795403:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916951.795422:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83d847 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f49e expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.795773:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83d84e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.795785:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83d84e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.795793:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83d84e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.797832:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d855 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.797858:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.797867:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788916951.798957:0:8069:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788916951.799590:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d85c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.799605:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d85c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.799615:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d85c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.799659:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83d84e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.799667:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83d84e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.799674:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83d84e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.799680:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916951.799685:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83d84e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.799694:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83d84e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.799722:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6e02ceec00) 00010000:00010000:2.0:1788916951.799725:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916951.799732:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83d84e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.799738:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83d84e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788916951.799755:0:8069:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ceb08c67 reply state 0000000062e46c90 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916951.799764:0:8069:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788916951.799805:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83d847 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f49e expref: 10 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.799817:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d85c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f49e expref: 9 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.799823:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6e02f3c800) 00010000:00010000:2.0:1788916951.799825:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788916951.799827:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e013fd800, rc 0) 00000100:00100000:2.0:1788916951.799965:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a771f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+10:9706:x1875815113442304:12345-192.168.202.40@tcp:101:touch.500 Request processed in 4599us (4956us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788916951.799972:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00010000:00010000:1.0:1788916951.801913:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.801928:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d855 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.801933:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d855 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.801937:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fc200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916951.801941:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d855 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.801947:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d855 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.801959:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd0c2206e (ffff9a6e02f3c600) 00010000:00010000:1.0:1788916951.801961:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788916951.801963:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d855 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.801967:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d855 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916951.804700:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916951.804902:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113442560 00000100:00100000:2.0:1788916951.804915:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113442560 00000100:00100000:2.0:1788916951.805024:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:2.0:1788916951.805034:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:9706:x1875815113442560:12345-192.168.202.40@tcp:36:touch.500 00010000:00010000:2.0:1788916951.805105:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916951.805136:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d85c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f49e expref: 9 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.805196:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6e02f3c800) 00010000:00010000:2.0:1788916951.805208:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788916951.805256:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d86a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.805271:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d86a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.805281:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d86a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788916951.805432:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049b2586b reply state 00000000ef064ff1 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d86a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916951.805443:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788916951.805547:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+10:9706:x1875815113442560:12345-192.168.202.40@tcp:36:touch.500 Request processed in 513us (855us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788916951.805553:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:1.0:1788916951.809801:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1788916951.809878:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d86a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.809902:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d86a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.809911:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d86a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.809938:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fdc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916951.809944:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d86a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.809953:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d86a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.809973:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6e02f3c100) 00010000:00010000:2.0:1788916951.809977:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916951.809984:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d86a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.809991:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d86a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916951.810090:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113442688 00000100:00100000:3.0:1788916951.810103:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113442688 00000100:00100000:3.0:1788916951.810203:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:3.0:1788916951.810216:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:9706:x1875815113442688:12345-192.168.202.40@tcp:101:touch.500 00010000:00010000:3.0:1788916951.810253:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916951.810283:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d871 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f4a5 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.810492:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d871 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4a5 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.810505:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d871 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4a5 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.810525:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6e02cee300) 00010000:00010000:3.0:1788916951.810527:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788916951.810538:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e200, rc 0) 00000100:00100000:3.0:1788916951.810604:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+10:9706:x1875815113442688:12345-192.168.202.40@tcp:101:touch.500 Request processed in 391us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916951.810611:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:1.0:1788916951.814017:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916951.814246:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113442816 00000100:00100000:3.0:1788916951.814256:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113442816 00000100:00100000:3.0:1788916951.814307:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:3.0:1788916951.814316:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2370:x1875815113442816:12345-192.168.202.40@tcp:8:touch.500 00010000:00080000:3.0:1788916951.814351:0:6590:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp t0 exp 0000000000000000 cur 347 last 0 00000020:00000080:3.0:1788916951.814392:0:6590:0:(genops.c:1407:class_connect()) connect: client 9afe8ff0-67c2-4292-b970-4ecb57096cb4, cookie 0x51de7f756a83d878 00002000:00100000:3.0:1788916951.814405:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9afe8ff0-67c2-4292-b970-4ecb57096cb4/ffff9a6e3f7fa000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371a ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788916951.814432:0:6590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788916951.814756:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788916951.814790:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9a6e3f7fa800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788916951.814872:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2370:x1875815113442816:12345-192.168.202.40@tcp:8:touch.500 Request processed in 553us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916951.814889:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:1.0:1788916951.820001:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916951.820122:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113442944 00000100:00100000:3.0:1788916951.820143:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113442944 00000100:00080000:1.0:1788916951.820255:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788916951.820259:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:3.0:1788916951.820270:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:0:x1875815113442944:12345-192.168.202.40@tcp:2:touch.500 00010000:00010000:3.0:1788916951.843300:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916951.863610:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:0:x1875815113442944:12345-192.168.202.40@tcp:2:touch.500 Request processed in 43326us (43604us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788916951.863627:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000001:00080000:1.0:1788916951.864869:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1788916951.864900:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9afe8ff0-67c2-4292-b970-4ecb57096cb4 00000100:00100000:1.0:1788916951.866782:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916951.866992:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113443200 00000100:00100000:3.0:1788916951.867028:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113443200 00000100:00100000:3.0:1788916951.867104:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:3.0:1788916951.867116:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+10:9706:x1875815113443200:12345-192.168.202.40@tcp:35:touch.500 00000100:00100000:3.0:1788916951.867532:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+11:9706:x1875815113443200:12345-192.168.202.40@tcp:35:touch.500 Request processed in 416us (756us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788916951.867540:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:0.0:1788916951.878571:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916951.878679:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113443328 00000100:00100000:3.0:1788916951.878690:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113443328 00000100:00100000:3.0:1788916951.878753:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:3.0:1788916951.878764:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+11:9707:x1875815113443328:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:3.0:1788916951.878793:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916951.878818:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d87f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f4ac expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.878913:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d886 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.878928:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.878940:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916951.879006:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788916951.879010:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788916951.879052:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.879082:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d87f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4ac expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.879117:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4ac expref: 12 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.879516:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6e02ceec00) 00010000:00010000:3.0:1788916951.879521:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788916951.879524:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18fc00, rc 0) 00000100:00100000:0.0:1788916951.879649:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+12:9707:x1875815113443328:12345-192.168.202.40@tcp:101:rm.0 Request processed in 884us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916951.879657:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:1.0:1788916951.882247:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916951.882529:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113443584 00000100:00100000:2.0:1788916951.882540:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113443584 00000100:00100000:2.0:1788916951.882636:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:2.0:1788916951.882647:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+12:9707:x1875815113443584:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:2.0:1788916951.882669:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916951.882690:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d88d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f4b3 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916951.882807:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788916951.882990:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d88d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4b3 expref: 14 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.883007:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:2.0:1788916951.883017:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788916951.883024:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d88d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4b3 expref: 14 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.883040:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e013fdc00, rc 0) 00000100:00100000:2.0:1788916951.883111:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+13:9707:x1875815113443584:12345-192.168.202.40@tcp:101:rm.0 Request processed in 466us (874us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788916951.883119:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:1.0:1788916951.890855:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916951.890951:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113443712 00000100:00100000:3.0:1788916951.890965:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113443712 00000100:00100000:3.0:1788916951.891040:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:3.0:1788916951.891052:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+13:9707:x1875815113443712:12345-192.168.202.40@tcp:37:rm.0 00000100:00100000:3.0:1788916951.900190:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+13:9707:x1875815113443712:12345-192.168.202.40@tcp:37:rm.0 Request processed in 9096us (9301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916951.900207:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:1.0:1788916951.905378:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916951.909887:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113443968 00000100:00100000:0.0:1788916951.909906:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113443968 00000100:00100000:0.0:1788916951.910067:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:0.0:1788916951.910081:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e08cff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+13:9707:x1875815113443968:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:0.0:1788916951.910452:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e08cff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:9707:x1875815113443968:12345-192.168.202.40@tcp:35:rm.0 Request processed in 373us (5082us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788916951.910460:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:1.0:1788916951.921366:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916951.921451:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113444224 00000100:00100000:2.0:1788916951.921462:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113444224 00000100:00100000:2.0:1788916951.921524:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:2.0:1788916951.921536:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:9707:x1875815113444224:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:2.0:1788916951.921562:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916951.921583:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d89b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f4ba expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.921754:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d8a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.921769:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d8a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.921779:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d8a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916951.921790:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788916951.921977:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d89b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4ba expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.921998:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d8a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4ba expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.922014:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6e02ceec00) 00010000:00010000:2.0:1788916951.922018:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788916951.922021:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e013fd800, rc 0) 00000100:00100000:2.0:1788916951.922102:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:9707:x1875815113444224:12345-192.168.202.40@tcp:101:rm.0 Request processed in 569us (744us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788916951.922111:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:1.0:1788916951.933421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916951.934215:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113444352 00000100:00100000:3.0:1788916951.934226:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113444352 00000100:00100000:3.0:1788916951.934297:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:3.0:1788916951.934307:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:9707:x1875815113444352:12345-192.168.202.40@tcp:41:rm.0 00000004:00000024:3.0:1788916951.934491:0:5794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788916951.934939:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:9707:x1875815113444352:12345-192.168.202.40@tcp:41:rm.0 Request processed in 633us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916951.934948:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:1.0:1788916951.937371:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916951.938093:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113444480 00000100:00100000:0.0:1788916951.938105:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113444480 00000100:00100000:0.0:1788916951.938228:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:0.0:1788916951.938237:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:9707:x1875815113444480:12345-192.168.202.40@tcp:101:rm.0 00010000:00010000:0.0:1788916951.938257:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916951.938278:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83d8b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f4c1 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938333:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d8b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938360:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d8b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938370:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d8b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938382:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d8be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938387:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d8be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938391:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d8be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938487:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2a00/0x51de7f756a83d8c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938492:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2a00/0x51de7f756a83d8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938509:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2a00/0x51de7f756a83d8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788916951.938537:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788916951.938542:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788916951.938560:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2a00/0x51de7f756a83d8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938573:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2a00/0x51de7f756a83d8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938592:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d8b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938599:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d8b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938606:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d8b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938611:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916951.938615:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d8b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938623:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d8b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938636:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6e02ceec00) 00010000:00010000:0.0:1788916951.938640:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916951.938645:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d8b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938651:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d8b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938664:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d8be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938670:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d8be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938676:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d8be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938684:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916951.938686:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d8be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938690:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d8be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938697:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd0c2206e (ffff9a6e03d86200) 00010000:00010000:0.0:1788916951.938700:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916951.938702:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d8be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938707:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d8be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938738:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83d8b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4c1 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938753:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2a00/0x51de7f756a83d8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4c1 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916951.938760:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6e02cee300) 00010000:00010000:0.0:1788916951.938763:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788916951.938765:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2a00, rc 0) 00000100:00100000:0.0:1788916951.938829:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+17:9707:x1875815113444480:12345-192.168.202.40@tcp:101:rm.0 Request processed in 592us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916951.938837:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:1.0:1788916951.941807:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916951.941938:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113444736 00000100:00100000:2.0:1788916951.941949:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113444736 00000100:00100000:2.0:1788916951.942009:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:2.0:1788916951.942019:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+17:9707:x1875815113444736:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:2.0:1788916951.942306:0:8069:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788916951.942338:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2a00/0x51de7f756a83d8c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4c1 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.942362:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d871 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4a5 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.942373:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6e02cee300) 00010000:00010000:2.0:1788916951.942389:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d886 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4ac expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.942397:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6e02ceec00) 00010000:00010000:2.0:1788916951.942401:0:8069:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788916951.942423:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.942456:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.942466:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.942484:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d8d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.942491:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d8d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.942567:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d8d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.942690:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.942770:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.942777:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788916951.945918:0:8069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788916951.945936:0:8069:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347977789040ns, next at 348977785278ns, rc = 0 00010000:00010000:2.0:1788916951.946026:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d8e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.946049:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d8e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.946075:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d8e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.946085:0:8069:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d8e1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.946092:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d8e1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.946099:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d8e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.946131:0:8069:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788916951.946633:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.946647:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8da lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.946653:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.946659:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fca00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916951.946665:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.946674:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8da lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.946690:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6e02f3c100) 00010000:00010000:2.0:1788916951.946694:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788916951.946709:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8da lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.946716:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8da lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.946741:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.946747:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8cc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.946752:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.946754:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788916951.946757:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fdc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916951.946760:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.946761:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d8e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.946766:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.946774:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6e02ceec00) 00010000:00010000:3.0:1788916951.946777:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fc200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788916951.946777:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916951.946779:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.946781:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d8e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.946786:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.946787:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d8e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.946795:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a6e02f3c100) 00010000:00010000:3.0:1788916951.946798:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000004:00010000:2.0:1788916951.946798:0:8069:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008dcb1d4a reply state 00000000214316bb transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d8d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.946801:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d8e1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916951.946807:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d8e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916951.946818:0:8069:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788916951.946825:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916951.946827:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916951.946828:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916951.946931:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:9707:x1875815113444736:12345-192.168.202.40@tcp:36:rm.0 Request processed in 4909us (5130us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788916951.946941:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00010000:00010000:1.0:1788916951.950276:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d8d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.950295:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d8d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.950304:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d8d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.950312:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fc000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916951.950317:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d8d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.950326:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d8d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.950345:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd0c2206e (ffff9a6e02f3c800) 00010000:00010000:1.0:1788916951.950361:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788916951.950367:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d8d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916951.950374:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d8d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd0c2206e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916951.951509:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916951.951573:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113444992 00000100:00100000:3.0:1788916951.951585:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113444992 00000100:00100000:3.0:1788916951.951648:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:3.0:1788916951.951659:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+15:9707:x1875815113444992:12345-192.168.202.40@tcp:35:rm.0 00000100:00100000:3.0:1788916951.952098:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:9707:x1875815113444992:12345-192.168.202.40@tcp:35:rm.0 Request processed in 440us (606us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788916951.952107:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:3.0:1788916951.954398:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916951.954800:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113445248 00000100:00100000:2.0:1788916951.954810:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113445248 00000100:00100000:2.0:1788916951.954940:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:2.0:1788916951.954953:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:9707:x1875815113445248:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:2.0:1788916951.955021:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788916951.955061:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fd800/0x51de7f756a83d8a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4ba expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.955085:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83d840 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f497 expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.955099:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6e02ceec00) 00010000:00010000:2.0:1788916951.955118:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83d801 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f489 expref: 14 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.955127:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:2.0:1788916951.955134:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788916951.955185:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.955199:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.955229:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.955245:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8ef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.955253:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.955260:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.955581:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d8f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.955590:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.955597:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916951.956310:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788916951.956327:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.956335:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d8f6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.956343:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d8f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.956350:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fcc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916951.956360:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d8f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.956368:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d8f6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.956378:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a6e02f3c600) 00010000:00010000:2.0:1788916951.956381:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788916951.956385:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d8f6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.956391:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fcc00/0x51de7f756a83d8f6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.956413:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.956419:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8e8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.956425:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.956431:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fdc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916951.956434:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.956439:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8e8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.956446:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02f3cd00) 00010000:00010000:2.0:1788916951.956449:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916951.956456:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8e8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.956463:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fdc00/0x51de7f756a83d8e8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788916951.956475:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000325a2308 reply state 00000000a0b705a5 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916951.956485:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788916951.956577:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+15:9707:x1875815113445248:12345-192.168.202.40@tcp:36:rm.0 Request processed in 1624us (2184us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788916951.956587:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00010000:00010000:2.0:1788916951.959135:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.959168:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8ef lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.959176:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8ef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.959182:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fca00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916951.959187:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8ef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.959196:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8ef lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.959217:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a6e02f3c100) 00010000:00010000:2.0:1788916951.959221:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916951.959226:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8ef lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916951.959249:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fca00/0x51de7f756a83d8ef lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916952.863593:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916953.640396:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140740608:0@lo:400:kworker.0 00000100:00100000:1.0:1788916953.640476:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916953.640575:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140740608 00000100:00100000:3.0:1788916953.640591:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140740608 00000100:00100000:3.0:1788916953.640642:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788916953.640651:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140740608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916953.648059:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140740736:0@lo:400:kworker.0 00000100:00100000:0.0:1788916953.648140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916953.648293:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140741248:0@lo:400:kworker.0 00000100:00100000:0.0:1788916953.648429:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916953.648460:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788916953.648468:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140741120:0@lo:400:kworker.0 00000100:00100000:0.0:1788916953.648495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916953.648546:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140740864:0@lo:400:kworker.0 00000100:00100000:0.0:1788916953.648577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916953.648604:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788916953.648612:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140740992:0@lo:400:kworker.0 00000100:00100000:0.0:1788916953.648640:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916953.648698:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140740736 00000100:00100000:0.0:1788916953.648706:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140740736 00000100:00100000:0.0:1788916953.648761:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140741120 00000100:00100000:0.0:1788916953.648764:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140741120 00000100:00100000:0.0:1788916953.649536:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140740864 00000100:00100000:0.0:1788916953.649541:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140740864 00000100:00100000:0.0:1788916953.649579:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788916953.649590:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140740736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916953.649659:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140740736:12345-0@lo:400:kworker.0 Request processed in 70us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916953.649669:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788916953.649707:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788916953.649717:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140741120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916953.649754:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140741120:12345-0@lo:400:kworker.0 Request processed in 40us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916953.649763:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788916953.649795:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788916953.649805:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140740864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916953.649852:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140740864:12345-0@lo:400:kworker.0 Request processed in 49us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916953.649860:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788916953.649902:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140741248 00000100:00100000:0.0:1788916953.649906:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140741248 00000100:00100000:0.0:1788916953.649943:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140740992 00000100:00100000:0.0:1788916953.649946:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140740992 00000100:00100000:0.0:1788916953.649978:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788916953.649987:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140741248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916953.650037:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140741248:12345-0@lo:400:kworker.0 Request processed in 52us (1610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916953.650045:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788916953.650066:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788916953.650075:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140740992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916953.650112:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140740992:12345-0@lo:400:kworker.0 Request processed in 39us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916953.650119:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788916953.650168:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788916953.650173:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788916953.650178:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788916953.650534:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140741120:0@lo:400:kworker.0 00000100:00100000:0.0:1788916953.650556:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140740736:0@lo:400:kworker.0 00010000:00080000:0.0:1788916953.650577:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2d0dc380 x1875815140741248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916953.650605:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140741248:0@lo:400:kworker.0 00010000:00080000:0.0:1788916953.650672:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2d0de680 x1875815140740992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916953.650736:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140740992:0@lo:400:kworker.0 00000100:00100000:0.0:1788916953.650757:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140740864:0@lo:400:kworker.0 00000100:00100000:3.0:1788916953.652202:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140740608:12345-0@lo:400:kworker.0 Request processed in 11546us (11720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916953.652216:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788916953.652840:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140740608:0@lo:400:kworker.0 00010000:00010000:3.0:1788916953.888034:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788916954.144320:0:7871:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350176170838ns, next at 351176167450ns, rc = 0 00000100:00100000:3.0:1788916954.144342:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788916954.144374:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140741376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788916954.144448:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916954.144470:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140741376 00000100:00100000:1.0:1788916954.144479:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140741376 00000100:00100000:1.0:1788916954.144545:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788916954.144580:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140741376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788916954.144616:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916954.144683:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140741376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916954.144691:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1788916954.144733:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6d01a80700 x1875815140741376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916954.144753:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140741376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788916954.657610:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140741504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788916954.657701:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916954.658172:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140741504 00000100:00100000:3.0:1788916954.658183:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140741504 00000100:00100000:3.0:1788916954.658247:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788916954.658258:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3727b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140741504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788916954.658301:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788916954.658359:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3727b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140741504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916954.658367:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788916954.658544:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6d01a80e00 x1875815140741504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916954.658572:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140741504:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788916954.911486:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788916955.091926:0:11472:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1788916955.528491:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916955.528523:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916955.528550:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916955.528574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916955.528603:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113445504 00000100:00100000:3.0:1788916955.528612:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113445504 00000100:00100000:3.0:1788916955.528668:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113445760 00000100:00100000:3.0:1788916955.528671:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113445760 00000100:00100000:3.0:1788916955.528751:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 95 00000100:00100000:3.0:1788916955.528761:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:2373:x1875815113445504:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788916955.528841:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:2373:x1875815113445504:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 82us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916955.528862:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 95 00000100:00100000:3.0:1788916955.528880:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 96 00000100:00100000:3.0:1788916955.528887:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2373:x1875815113445760:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788916955.528911:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2373:x1875815113445760:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916955.528917:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 96 00000100:00100000:3.0:1788916955.528944:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113445376 00000100:00100000:3.0:1788916955.528948:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113445376 00000100:00100000:3.0:1788916955.528975:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 247 00000100:00100000:3.0:1788916955.528982:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:2373:x1875815113445376:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788916955.529006:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:2373:x1875815113445376:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916955.529012:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 247 00000100:00100000:3.0:1788916955.529044:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113445632 00000100:00100000:3.0:1788916955.529048:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113445632 00000100:00100000:3.0:1788916955.529077:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:3.0:1788916955.529084:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2373:x1875815113445632:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788916955.529110:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2373:x1875815113445632:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916955.529117:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00080000:3.0:1788916955.529133:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788916955.529143:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1788916955.896021:0:11520:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffec585e80 20000000:00000080:0.0:1788916955.896041:0:11520:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6e2d0e9c00 uarg=0000000000000000 20000000:01000000:0.0:1788916955.896087:0:11520:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788916955.896095:0:11520:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788916955.896101:0:11520:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788916955.896872:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788916955.897050:0:11520:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788916955.907916:0:11520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788916955.908229:0:11520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788916955.908302:0:11520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788916955.908321:0:11520:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788916955.908343:0:11520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6e06ee3c00/0x51de7f756a83d8fd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.908364:0:11520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d79f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f474 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.908373:0:11520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e2d18ec00/0x51de7f756a83d7a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f47b expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.908382:0:11520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e06ee2c00/0x51de7f756a83d7b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d7ad expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.908404:0:11520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d7c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d7bb expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.908411:0:11520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d7d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d7c9 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.908419:0:11520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6e06ee3c00/0x51de7f756a83d8fd lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.908527:0:11520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d7d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d7c9 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.908543:0:11520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d7d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d7c9 expref: 18 pid: 5787 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916955.908558:0:11520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1875815140741632:0@lo:104: 00000100:00100000:0.0:1788916955.908629:0:11520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788916955.908754:0:11520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d7c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d7bb expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.908763:0:11520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d7c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d7bb expref: 18 pid: 5784 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916955.908772:0:11520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0dc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1875815140741760:0@lo:104: 00000100:00100000:0.0:1788916955.908796:0:11520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788916955.908946:0:11520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e06ee2c00/0x51de7f756a83d7b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83d7ad expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.908955:0:11520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6e06ee2c00/0x51de7f756a83d7b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83d7ad expref: 18 pid: 5784 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916955.908970:0:11520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1875815140741888:0@lo:104: 00000100:00100000:0.0:1788916955.909094:0:11520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916955.909120:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140741632 00000100:00100000:3.0:1788916955.909128:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140741632 00000100:00100000:3.0:1788916955.909192:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140741760 00000100:00100000:3.0:1788916955.909196:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140741760 00000100:00100000:3.0:1788916955.909212:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788916955.909220:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+4:11520:x1875815140741632:12345-0@lo:104: 00010000:00010000:3.0:1788916955.909233:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83d7c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d7d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.909282:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788916955.909288:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+4:11520:x1875815140741632:12345-0@lo:104: Request processed in 69us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916955.909296:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788916955.909314:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788916955.909320:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+3:11520:x1875815140741760:12345-0@lo:104: 00010000:00010000:3.0:1788916955.909328:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d7bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d7c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.909358:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788916955.909363:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+3:11520:x1875815140741760:12345-0@lo:104: Request processed in 44us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916955.909369:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788916955.909384:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788916955.909389:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83d7c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d7d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.909396:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3000 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1788916955.909400:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83d7c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d7d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.909414:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83d7c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d7d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788916955.909421:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83d7c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d7d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788916955.909426:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788916955.909465:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83d7c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d7d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.909471:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788916955.909494:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83d7c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d7d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.909501:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83d7c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d7d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.909511:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788916955.909514:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d7bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d7c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.909520:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f000 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1788916955.909522:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d7bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d7c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.909528:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d7bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d7c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788916955.909533:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d7bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d7c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788916955.909543:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788916955.909557:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d7bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d7c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.909563:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788916955.909569:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d7bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d7c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.909575:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d7bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d7c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.909584:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916955.909585:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916955.909587:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916955.909593:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916955.909603:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140742144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788916955.909629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916955.909651:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788916955.909657:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140742016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788916955.909674:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916955.909697:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140742144 00000100:00100000:3.0:1788916955.909700:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140742144 00010000:00010000:3.0:1788916955.909717:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d7c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d7bb expref: 19 pid: 5784 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916955.909734:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140742016 00000100:00100000:3.0:1788916955.909736:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140742016 00010000:00010000:3.0:1788916955.909744:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d7d0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d7c9 expref: 20 pid: 5787 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916955.909772:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788916955.909778:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4933373a-b540-4420-bf34-9071e19d7373+20:3305:x1875815140742144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788916955.909788:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916955.909793:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d7c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d7bb expref: 20 pid: 5784 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.909803:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d7c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d7bb expref: 20 pid: 5784 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.909817:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916955.909860:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4933373a-b540-4420-bf34-9071e19d7373+20:3305:x1875815140742144:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916955.909866:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788916955.909879:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788916955.909884:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140742016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788916955.909891:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916955.909896:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d7d0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d7c9 expref: 19 pid: 5787 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.909905:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d7d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d7c9 expref: 19 pid: 5787 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.909913:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916955.909935:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140742016:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916955.909941:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788916955.910216:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140742016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788916955.910226:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140742144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788916955.910444:0:11520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e2d18ec00/0x51de7f756a83d7a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f47b expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.910457:0:11520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6e2d18ec00/0x51de7f756a83d7a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f47b expref: 12 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916955.910468:0:11520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0ded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1875815140742272:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788916955.910530:0:11520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d79f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f474 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.910539:0:11520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d79f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f474 expref: 12 pid: 5787 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916955.910548:0:11520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0dce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1875815140742400:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788916955.910569:0:11520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e408b0c00 going to sleep for 11 seconds 00010000:00010000:0.0:1788916955.910582:0:11520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e06ee2800/0x51de7f756a83d7d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d7c9 expref: 18 pid: 5787 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916955.910591:0:11520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1875815140741632:0@lo:104: 00010000:00010000:0.0:1788916955.910599:0:11520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e06ee3400/0x51de7f756a83d7c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d7bb expref: 17 pid: 5784 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916955.910606:0:11520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0dc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1875815140741760:0@lo:104: 00000100:00100000:3.0:1788916955.911784:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788916955.911813:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140741888 00000100:00100000:3.0:1788916955.911820:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140741888 00000100:00100000:3.0:1788916955.911913:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788916955.911922:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f305850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+3:11520:x1875815140741888:12345-0@lo:104: 00010000:00010000:3.0:1788916955.911935:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18fa00/0x51de7f756a83d7ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d7b4 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.912221:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788916955.912228:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f305850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4933373a-b540-4420-bf34-9071e19d7373+3:11520:x1875815140741888:12345-0@lo:104: Request processed in 308us (3134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916955.912236:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788916955.912617:0:11520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1875815140741888:0@lo:104: 00000100:00100000:0.0:1788916955.913655:0:11520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0ded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1875815140742272:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788916955.913677:0:11520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0dce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1875815140742400:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788916955.913723:0:11520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6e06ee3c00/0x51de7f756a83d8fd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916955.914058:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788916955.914065:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18fa00/0x51de7f756a83d7ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83d7b4 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916955.914073:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18fa00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1788916955.914078:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18fa00/0x51de7f756a83d7ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83d7b4 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916955.914087:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18fa00/0x51de7f756a83d7ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83d7b4 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788916955.914094:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18fa00/0x51de7f756a83d7ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83d7b4 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788916955.914100:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788916955.914165:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18fa00/0x51de7f756a83d7ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d7b4 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916955.914182:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788916955.914209:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18fa00/0x51de7f756a83d7ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d7b4 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916955.914215:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140742528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788916955.914216:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18fa00/0x51de7f756a83d7ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83d7b4 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916955.914233:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916955.914234:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916955.914236:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916955.914257:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916955.914383:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140742528 00000100:00100000:2.0:1788916955.914389:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140742528 00010000:00010000:2.0:1788916955.914414:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e06ee2c00/0x51de7f756a83d7b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d7ad expref: 17 pid: 5784 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916955.914454:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788916955.914463:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e408e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4933373a-b540-4420-bf34-9071e19d7373+17:3306:x1875815140742528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788916955.914478:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916955.914485:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e06ee2c00/0x51de7f756a83d7b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83d7ad expref: 17 pid: 5784 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916955.914495:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e06ee2c00/0x51de7f756a83d7b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83d7ad expref: 17 pid: 5784 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916955.914510:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e06ee2c00/0x51de7f756a83d7b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83d7ad expref: 17 pid: 5784 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916955.914522:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788916955.914569:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e408e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4933373a-b540-4420-bf34-9071e19d7373+16:3306:x1875815140742528:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916955.914581:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788916955.914768:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140742528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788916955.915618:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916955.915863:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113445888 00000100:00100000:3.0:1788916955.915872:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113445888 00010000:00010000:3.0:1788916955.915913:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e2d18ec00/0x51de7f756a83d7a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f47b expref: 13 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916955.915949:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:3.0:1788916955.915958:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3727b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f367f55b-9b55-442e-a009-d3d404e176a2+13:2373:x1875815113445888:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788916955.915969:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916955.915974:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e2d18ec00/0x51de7f756a83d7a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f47b expref: 13 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.915984:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e2d18ec00/0x51de7f756a83d7a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f47b expref: 13 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.915999:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e2d18ec00/0x51de7f756a83d7a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f47b expref: 13 pid: 5786 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.916011:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916955.916066:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3727b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f367f55b-9b55-442e-a009-d3d404e176a2+12:2373:x1875815113445888:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 109us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916955.916074:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:3.0:1788916955.920297:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916955.920449:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113446016 00000100:00100000:0.0:1788916955.920459:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113446016 00010000:00010000:0.0:1788916955.920499:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d79f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f474 expref: 12 pid: 5787 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916955.920540:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:0.0:1788916955.920551:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f367f55b-9b55-442e-a009-d3d404e176a2+12:2374:x1875815113446016:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788916955.920566:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788916955.920572:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d79f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f474 expref: 12 pid: 5787 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.920584:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d79f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f474 expref: 12 pid: 5787 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.920601:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d79f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f474 expref: 12 pid: 5787 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.920616:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6e06ee3c00/0x51de7f756a83d8fd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.920626:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee3c00/0x51de7f756a83d8fd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.920655:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e06ee3c00/0x51de7f756a83d8fd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.920663:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e06ee3c00/0x51de7f756a83d8fd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.920670:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6e06ee3c00/0x51de7f756a83d8fd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.920677:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6e06ee3c00/0x51de7f756a83d8fd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.920683:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3c00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788916955.920687:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6e06ee3c00/0x51de7f756a83d8fd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.920695:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6e06ee3c00/0x51de7f756a83d8fd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.920721:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6e06ee3c00/0x51de7f756a83d8fd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916955.920733:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788916955.920788:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f367f55b-9b55-442e-a009-d3d404e176a2+11:2374:x1875815113446016:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 239us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916955.920796:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00010000:00010000:2.0:1788916955.921117:0:11520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6e06ee3c00/0x51de7f756a83d8fd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916955.921127:0:11520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee3c00/0x51de7f756a83d8fd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916955.921134:0:11520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e06ee3c00/0x51de7f756a83d8fd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916955.936883:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916956.962009:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788916957.151269:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788916957.151277:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e3f439800 from 7 10000000:01000000:3.0:1788916957.151282:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788916957.151338:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83d904 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916957.151351:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83d904 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916957.151363:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83d904 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916957.151391:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140742656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788916957.151465:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916957.151602:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3728d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788916957.151887:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140742656 00000100:00100000:0.0:1788916957.151895:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140742656 00000100:00100000:0.0:1788916957.151985:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788916957.151996:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+16:5789:x1875815140742656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788916957.152025:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916957.152040:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d90b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d904 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916957.152063:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d90b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d904 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916957.152074:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d90b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d904 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916957.152084:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2e00, rc 0) 00000100:00100000:0.0:1788916957.152142:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140742656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916957.152182:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788916957.152268:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140742656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788916957.152286:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83d904 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d90b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916957.152295:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83d904 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d90b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916957.152356:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37278380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140742784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788916957.152383:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916957.152615:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e2cf27480 going to sleep for 11 seconds 00000100:00100000:3.0:1788916957.152746:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140742784 00000100:00100000:3.0:1788916957.152751:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140742784 00000100:00100000:3.0:1788916957.152774:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788916957.152781:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140742784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788916957.153064:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140742784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916957.153072:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788916957.153260:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37278380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140742784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788916957.153294:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37278380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140742912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788916957.153332:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916957.153358:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e2cf27480 going to sleep for 11 seconds 00000100:00100000:3.0:1788916957.153406:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140742912 00000100:00100000:3.0:1788916957.153411:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140742912 00000100:00100000:3.0:1788916957.153437:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788916957.153443:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140742912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788916957.153964:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140742912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 520us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916957.153972:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788916957.154077:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37278380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140742912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788916957.154564:0:11533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:11533:1875815140743040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788916957.154610:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916957.154691:0:11533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36aca540 going to sleep for 11 seconds 00000100:00100000:0.0:1788916957.154730:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140743040 00000100:00100000:0.0:1788916957.154736:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140743040 00000100:00100000:0.0:1788916957.154888:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788916957.154899:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+17:11533:x1875815140743040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788916957.155082:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+17:11533:x1875815140743040:12345-0@lo:502:llog_process_th.0 Request processed in 184us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916957.155090:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788916957.155186:0:11533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:11533:1875815140743040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788916957.155212:0:11533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788916957.155222:0:11533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788916957.155225:0:11533:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788916957.155231:0:11533:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a6e3f439800 00000020:00000080:2.0:1788916957.155234:0:11533:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788916957.155316:0:11533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:11533:1875815140743168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788916957.155350:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916957.159578:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140743168 00000100:00100000:3.0:1788916957.159591:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140743168 00000100:00100000:3.0:1788916957.159640:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788916957.159650:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+17:11533:x1875815140743168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788916957.159945:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+17:11533:x1875815140743168:12345-0@lo:502:llog_process_th.0 Request processed in 295us (4592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916957.159953:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788916957.160346:0:11533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36aca540 going to sleep for 11 seconds 00000100:00100000:2.0:1788916957.160371:0:11533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:11533:1875815140743168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788916957.160408:0:11533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788916957.160416:0:11533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788916957.160418:0:11533:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788916957.160429:0:11533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788916957.160593:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788916957.160619:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788916957.160632:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83d904 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d90b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916957.160643:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83d904 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d90b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788916957.160654:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788916957.160657:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e2c984800 from 7 10000000:01000000:3.0:1788916957.160660:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788916957.160695:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d912 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916957.160703:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d912 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916957.160724:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d912 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916957.160747:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140743296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788916957.160788:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916957.160821:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3728d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788916957.160922:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140743296 00000100:00100000:2.0:1788916957.160927:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140743296 00000100:00100000:2.0:1788916957.160962:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788916957.160969:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+17:5789:x1875815140743296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788916957.160979:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916957.160992:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d919 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d912 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916957.161014:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d912 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916957.161023:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d919 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d912 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916957.161032:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e013fcc00, rc 0) 00000100:00100000:2.0:1788916957.161061:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140743296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916957.161067:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788916957.161136:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140743296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788916957.161243:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d912 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d919 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916957.161254:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d912 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d919 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916957.161308:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140743424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788916957.161332:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916957.161347:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3728d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788916957.161419:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140743424 00000100:00100000:2.0:1788916957.161424:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140743424 00000100:00100000:2.0:1788916957.161443:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788916957.161449:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140743424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788916957.161689:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140743424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916957.161695:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788916957.161766:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140743424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788916957.161868:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140743552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788916957.161906:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916957.161936:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3728d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788916957.162978:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140743552 00000100:00100000:2.0:1788916957.162988:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140743552 00000100:00100000:2.0:1788916957.163024:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788916957.163041:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e069d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140743552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788916957.163339:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e069d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140743552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 299us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916957.163348:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788916957.163451:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140743552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788916957.172221:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a80a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:11535:1875815140743680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788916957.172312:0:11535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916957.174299:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3728d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788916957.174901:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140743680 00000100:00100000:0.0:1788916957.174914:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140743680 00000100:00100000:0.0:1788916957.175025:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788916957.175037:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+18:11535:x1875815140743680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788916957.176123:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a623850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+18:11535:x1875815140743680:12345-0@lo:502:llog_process_th.0 Request processed in 1085us (3808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916957.176142:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788916957.176285:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a80a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:11535:1875815140743680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788916957.176321:0:11535:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788916957.176330:0:11535:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788916957.176333:0:11535:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788916957.176340:0:11535:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a6e2c984800 00000020:00000080:2.0:1788916957.176343:0:11535:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788916957.176773:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:11535:1875815140743808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788916957.176847:0:11535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916957.180197:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01eff180 going to sleep for 11 seconds 00000100:00100000:0.0:1788916957.180364:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140743808 00000100:00100000:0.0:1788916957.180373:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140743808 00000100:00100000:0.0:1788916957.180408:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788916957.180417:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+18:11535:x1875815140743808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788916957.180668:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+18:11535:x1875815140743808:12345-0@lo:502:llog_process_th.0 Request processed in 252us (3821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916957.180677:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000040:00080000:1.0:1788916957.182325:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788916957.183336:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:11535:1875815140743808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788916957.183377:0:11535:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788916957.183386:0:11535:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788916957.183388:0:11535:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788916957.183392:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788916957.183452:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788916957.183475:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788916957.183487:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d912 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d919 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916957.183499:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d912 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d919 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788916957.183510:0:5789:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788916957.183518:0:5789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e171d2800 from 7 10000000:01000000:2.0:1788916957.183521:0:5789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788916957.183555:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fd800/0x51de7f756a83d920 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916957.183564:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e013fd800/0x51de7f756a83d920 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916957.183574:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e013fd800/0x51de7f756a83d920 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916957.183596:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140743936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788916957.183653:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916957.183688:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01eff180 going to sleep for 11 seconds 00000100:00100000:2.0:1788916957.183704:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140743936 00000100:00100000:2.0:1788916957.183709:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140743936 00000100:00100000:2.0:1788916957.183746:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788916957.183755:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+18:5789:x1875815140743936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788916957.183767:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916957.183781:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e013fdc00/0x51de7f756a83d927 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83d920 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916957.183803:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e013fdc00/0x51de7f756a83d927 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83d920 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916957.183814:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e013fdc00/0x51de7f756a83d927 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83d920 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916957.184038:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e013fdc00, rc 0) 00000100:00100000:2.0:1788916957.184076:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b461450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140743936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 321us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916957.184090:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788916957.184126:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140743936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788916957.184139:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e013fd800/0x51de7f756a83d920 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d927 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916957.184260:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e013fd800/0x51de7f756a83d920 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d927 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916957.184307:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140744064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788916957.184333:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916957.184351:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01eff180 going to sleep for 11 seconds 00000100:00100000:2.0:1788916957.184362:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140744064 00000100:00100000:2.0:1788916957.184365:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140744064 00000100:00100000:2.0:1788916957.184382:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788916957.184388:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140744064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788916957.184617:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b461c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140744064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916957.184625:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788916957.184653:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140744064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788916957.184680:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140744192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788916957.184713:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916957.184725:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6d01eff180 going to sleep for 11 seconds 00000100:00100000:2.0:1788916957.184736:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140744192 00000100:00100000:2.0:1788916957.184739:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140744192 00000100:00100000:2.0:1788916957.184755:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788916957.184768:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140744192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788916957.184923:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b463450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:5789:x1875815140744192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916957.184931:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788916957.184964:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4933373a-b540-4420-bf34-9071e19d7373:5789:1875815140744192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788916957.188454:0:11539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:11539:1875815140744320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788916957.188532:0:11539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916957.188569:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140744320 00000100:00100000:2.0:1788916957.188575:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140744320 00000100:00100000:2.0:1788916957.188610:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788916957.188619:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:11539:x1875815140744320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788916957.188813:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b463c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:11539:x1875815140744320:12345-0@lo:502:llog_process_th.0 Request processed in 194us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916957.188821:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788916957.188882:0:11539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b16b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788916957.188905:0:11539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:11539:1875815140744320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788916957.188933:0:11539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788916957.188942:0:11539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788916957.188945:0:11539:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788916957.188951:0:11539:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a6e171d2800 00000020:00000080:2.0:1788916957.188953:0:11539:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788916957.190292:0:11539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a82300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:11539:1875815140744448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788916957.190339:0:11539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916957.190362:0:11539:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3728de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788916957.190455:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140744448 00000100:00100000:0.0:1788916957.190461:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140744448 00000100:00100000:0.0:1788916957.190503:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788916957.190511:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:11539:x1875815140744448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788916957.190669:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b462c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:11539:x1875815140744448:12345-0@lo:502:llog_process_th.0 Request processed in 158us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916957.190676:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788916957.190904:0:11539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a82300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4933373a-b540-4420-bf34-9071e19d7373:11539:1875815140744448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788916957.190928:0:11539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788916957.190934:0:11539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788916957.190936:0:11539:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788916957.190945:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788916957.191088:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788916957.191109:0:5789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788916957.191119:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fd800/0x51de7f756a83d920 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d927 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916957.191131:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e013fd800/0x51de7f756a83d920 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d927 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788916957.251576:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:1.0:1788916957.251592:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1788916957.251601:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:1.0:1788916957.251628:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:0.0:1788916957.251828:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140744576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788916957.251919:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916957.251973:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140744576 00000100:00100000:1.0:1788916957.251983:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140744576 00000100:00100000:1.0:1788916957.252059:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788916957.252070:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140744576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788916957.252098:0:6592:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788916957.252136:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa0b4d6, atime: 0x6aa0b4d6, ctime: 0x6aa0b4d6, blocks: 0x1 00010000:00010000:1.0:1788916957.252183:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83d92e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916957.252201:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=353s v=(0 0) 00010000:00010000:1.0:1788916957.252206:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788916957.252214:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83d92e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916957.252244:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83d92e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916957.252256:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83d92e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916957.252265:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83d92e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916957.252288:0:6592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788916957.252314:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788916957.252328:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83d92e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916957.252399:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaaa00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788916957.252404:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83d92e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916957.252415:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83d92e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916957.252437:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83d92e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916957.252446:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83d92e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916957.252469:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916957.252471:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916957.252473:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916957.252896:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140744576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 826us (976us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788916957.252905:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788916957.253031:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788916957.253295:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6d01a82300/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788916957.253301:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140744576:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788916957.768031:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916957.768613:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113446144 00000100:00100000:2.0:1788916957.768624:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113446144 00000100:00100000:2.0:1788916957.768683:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 263 00000100:00100000:2.0:1788916957.768695:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+11:5593:x1875815113446144:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788916957.768729:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916957.768750:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e013fca00/0x51de7f756a83d935 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f4c8 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916957.768783:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e013fca00/0x51de7f756a83d935 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4c8 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916957.768795:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e013fca00/0x51de7f756a83d935 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4c8 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916957.768805:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e013fca00, rc 0) 00000100:00100000:2.0:1788916957.769008:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b460050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+12:5593:x1875815113446144:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 315us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916957.769016:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 263 00000100:00100000:1.0:1788916957.777936:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916957.778078:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113446272 00000100:00100000:3.0:1788916957.778088:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113446272 00000100:00100000:3.0:1788916957.778177:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 264 00000100:00100000:3.0:1788916957.778188:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+12:5593:x1875815113446272:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788916957.778687:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b462850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+12:5593:x1875815113446272:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 500us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916957.778696:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 264 00000100:00100000:0.0:1788916957.782866:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916957.782967:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113446400 00000100:00100000:2.0:1788916957.782978:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113446400 00000100:00100000:2.0:1788916957.783035:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 265 00000100:00100000:2.0:1788916957.783045:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+12:5593:x1875815113446400:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788916957.783390:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b460450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+12:5593:x1875815113446400:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 346us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916957.783399:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 265 00000100:00100000:1.0:1788916957.787689:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916957.795126:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113446528 00000100:00100000:0.0:1788916957.795169:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113446528 00000100:00100000:0.0:1788916957.795247:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 266 00000100:00100000:0.0:1788916957.795256:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+12:9979:x1875815113446528:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788916957.795622:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b461050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+12:9979:x1875815113446528:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 365us (7941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916957.795636:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 266 00000100:00100000:1.0:1788916957.799504:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916957.799595:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113446656 00000100:00100000:3.0:1788916957.799606:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113446656 00000100:00100000:3.0:1788916957.799663:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 267 00000100:00100000:3.0:1788916957.799673:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+12:9979:x1875815113446656:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788916957.799954:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b463050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+12:9979:x1875815113446656:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 282us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916957.799963:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 267 00000100:00100000:1.0:1788916957.807998:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916957.808459:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113446784 00000100:00100000:0.0:1788916957.808471:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113446784 00000100:00100000:0.0:1788916957.808525:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 268 00000100:00100000:0.0:1788916957.808534:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+12:5593:x1875815113446784:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788916957.808552:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916957.808571:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee2a00/0x51de7f756a83d93c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f4cf expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916957.808598:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee2a00/0x51de7f756a83d93c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4cf expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916957.808610:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee2a00/0x51de7f756a83d93c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4cf expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916957.808619:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2a00, rc 0) 00000100:00100000:0.0:1788916957.808678:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b463850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+13:5593:x1875815113446784:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 146us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916957.808686:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 268 00000100:00100000:0.0:1788916957.810633:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916957.810757:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113446912 00000100:00100000:1.0:1788916957.810779:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113446912 00000100:00100000:1.0:1788916957.810841:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 269 00000100:00100000:1.0:1788916957.810852:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:5593:x1875815113446912:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788916957.811333:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b461850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:5593:x1875815113446912:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 482us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916957.811342:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 269 00000100:00100000:1.0:1788916957.818250:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916957.818371:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113447040 00000100:00100000:3.0:1788916957.818381:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113447040 00000100:00100000:3.0:1788916957.818450:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 270 00000100:00100000:3.0:1788916957.818461:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:5593:x1875815113447040:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788916957.818715:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b460c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:5593:x1875815113447040:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 255us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916957.818723:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 270 00000100:00100000:1.0:1788916957.821413:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916957.821622:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113447168 00000100:00100000:2.0:1788916957.821631:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113447168 00000100:00100000:2.0:1788916957.821680:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 271 00000100:00100000:2.0:1788916957.821690:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:9982:x1875815113447168:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788916957.821960:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b460850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:9982:x1875815113447168:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 270us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916957.821972:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 271 00000100:00100000:1.0:1788916957.825006:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916957.825263:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113447296 00000100:00100000:3.0:1788916957.825272:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113447296 00000100:00100000:3.0:1788916957.825326:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 272 00000100:00100000:3.0:1788916957.825336:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0b462050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:9982:x1875815113447296:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788916957.825601:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0b462050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:9982:x1875815113447296:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 265us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916957.825609:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 272 00010000:00010000:2.0:1788916957.983638:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788916958.240327:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788916958.751672:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140744832:0@lo:400:kworker.0 00000100:00100000:2.0:1788916958.751768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916958.751873:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140745344:0@lo:400:kworker.0 00000100:00100000:2.0:1788916958.751904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916958.751937:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788916958.751944:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140744704:0@lo:400:kworker.0 00000100:00100000:2.0:1788916958.751989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916958.752014:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140745216:0@lo:400:kworker.0 00000100:00100000:2.0:1788916958.752037:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916958.752071:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140744704 00000100:00100000:2.0:1788916958.752085:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140744704 00000100:00100000:2.0:1788916958.752134:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788916958.752166:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140744704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916958.752221:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140744704:12345-0@lo:400:kworker.0 Request processed in 79us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916958.752229:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788916958.752280:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140744704:0@lo:400:kworker.0 00000100:00100000:0.0:1788916958.752431:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140745088:0@lo:400:kworker.0 00000100:00100000:0.0:1788916958.752463:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916958.752497:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788916958.752503:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140744960:0@lo:400:kworker.0 00000100:00100000:0.0:1788916958.752526:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916958.752557:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140744832 00000100:00100000:0.0:1788916958.752580:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140744832 00000100:00100000:0.0:1788916958.752611:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140745216 00000100:00100000:0.0:1788916958.752614:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140745216 00000100:00100000:0.0:1788916958.752638:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140744960 00000100:00100000:0.0:1788916958.752641:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140744960 00000100:00100000:0.0:1788916958.752657:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788916958.752662:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140744832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916958.752704:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140744832:12345-0@lo:400:kworker.0 Request processed in 41us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916958.752711:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788916958.752724:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788916958.752731:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140745216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916958.752759:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140745216:12345-0@lo:400:kworker.0 Request processed in 29us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916958.752765:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788916958.752777:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788916958.752783:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140744960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916958.752825:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140744960:12345-0@lo:400:kworker.0 Request processed in 32us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916958.752832:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1788916958.752855:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788916958.752878:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140744960:0@lo:400:kworker.0 00000100:00100000:0.0:1788916958.752902:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140745216:0@lo:400:kworker.0 00000100:00100000:0.0:1788916958.752914:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140744832:0@lo:400:kworker.0 00000100:00100000:3.0:1788916958.753217:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140745344 00000100:00100000:3.0:1788916958.753222:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140745344 00000100:00100000:3.0:1788916958.753258:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140745088 00000100:00100000:3.0:1788916958.753262:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140745088 00000100:00100000:3.0:1788916958.753292:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788916958.753298:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140745344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916958.753343:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140745344:12345-0@lo:400:kworker.0 Request processed in 44us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916958.753349:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788916958.753362:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788916958.753368:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140745088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916958.753400:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140745088:12345-0@lo:400:kworker.0 Request processed in 33us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916958.753407:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788916958.753423:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788916958.753443:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6d01a80a80 x1875815140745088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916958.753466:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140745088:0@lo:400:kworker.0 00000100:00100000:3.0:1788916958.753495:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140745344:0@lo:400:kworker.0 00010000:00010000:0.0:1788916959.008960:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916959.264746:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788916959.264779:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140745472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788916959.264861:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916959.266458:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140745472 00000100:00100000:3.0:1788916959.266473:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140745472 00000100:00100000:3.0:1788916959.266548:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788916959.266560:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140745472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788916959.266612:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788916959.266698:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140745472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916959.266706:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788916959.266768:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140745472:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788916959.267218:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788916959.775916:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140745600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788916959.776008:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916959.776371:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140745600 00000100:00100000:1.0:1788916959.776381:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140745600 00000100:00100000:1.0:1788916959.776477:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788916959.776487:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140745600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788916959.776527:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916959.776869:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140745600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 383us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916959.776878:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788916959.776950:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2c992a00 x1875815140745600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916959.776970:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140745600:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788916960.033522:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916960.648819:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916960.648865:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916960.648908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916960.648941:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916960.648977:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113447680 00000100:00100000:1.0:1788916960.648987:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113447680 00000100:00100000:1.0:1788916960.649053:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:1.0:1788916960.649064:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3727a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2373:x1875815113447680:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788916960.649189:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3727a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2373:x1875815113447680:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 126us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916960.649209:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00080000:1.0:1788916960.649296:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788916960.649373:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113447552 00000100:00100000:2.0:1788916960.649377:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113447552 00000100:00100000:2.0:1788916960.649422:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113447808 00000100:00100000:2.0:1788916960.649426:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113447808 00000100:00100000:2.0:1788916960.649458:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 100 00000100:00100000:2.0:1788916960.649466:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2373:x1875815113447552:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788916960.649503:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2373:x1875815113447552:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 38us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916960.649509:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 100 00000100:00100000:2.0:1788916960.649523:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 101 00000100:00100000:2.0:1788916960.649528:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2373:x1875815113447808:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788916960.649552:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2373:x1875815113447808:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916960.649558:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 101 00000100:00100000:3.0:1788916960.649816:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113447424 00000100:00100000:3.0:1788916960.649820:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113447424 00000100:00100000:3.0:1788916960.649866:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 274 00000100:00100000:3.0:1788916960.649891:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+13:2373:x1875815113447424:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788916960.649919:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+13:2373:x1875815113447424:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 30us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916960.649925:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 274 00000100:00080000:0.0:1788916960.652680:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788916961.056075:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916962.079439:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788916962.403557:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1788916963.104786:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916963.871487:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140745856:0@lo:400:kworker.0 00000100:00100000:2.0:1788916963.871487:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140745984:0@lo:400:kworker.0 00000100:00100000:0.0:1788916963.871564:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140745728:0@lo:400:kworker.0 00000100:00100000:3.0:1788916963.871880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916963.871976:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140746368:0@lo:400:kworker.0 00000100:00100000:3.0:1788916963.872001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916963.872126:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140746112:0@lo:400:kworker.0 00000100:00100000:3.0:1788916963.872192:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916963.872227:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140746368 00000100:00100000:3.0:1788916963.872233:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140746368 00000100:00100000:3.0:1788916963.872282:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140746112 00000100:00100000:3.0:1788916963.872285:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140746112 00000100:00100000:3.0:1788916963.872308:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788916963.872316:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140746368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916963.872504:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140746368:12345-0@lo:400:kworker.0 Request processed in 187us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916963.872512:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788916963.872530:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788916963.872537:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140746112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916963.872571:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140746112:12345-0@lo:400:kworker.0 Request processed in 35us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916963.872577:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1788916963.872616:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e28d60a80 x1875815140746112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788916963.872631:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140746112:0@lo:400:kworker.0 00000100:00100000:3.0:1788916963.872661:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788916963.872666:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6d01a82300, transno 4294967300 00000100:00100000:3.0:1788916963.872676:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140746368:0@lo:400:kworker.0 00000100:00080000:3.0:1788916963.873039:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788916963.873043:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788916963.874759:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140745856 00000100:00100000:1.0:1788916963.874783:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140745856 00000100:00100000:3.0:1788916963.874877:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788916963.874890:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140745856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916963.874980:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140745856:12345-0@lo:400:kworker.0 Request processed in 93us (3100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916963.875000:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788916963.875062:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140745856:0@lo:400:kworker.0 00000100:00100000:0.0:1788916963.878239:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916963.878302:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140746240:0@lo:400:kworker.0 00000100:00100000:0.0:1788916963.878340:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916963.878727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916963.879307:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140745728 00000100:00100000:3.0:1788916963.879316:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140745728 00000100:00100000:3.0:1788916963.879372:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788916963.879382:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140745728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916963.879444:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140745728:12345-0@lo:400:kworker.0 Request processed in 63us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916963.879451:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788916963.880193:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140745728:0@lo:400:kworker.0 00000100:00100000:0.0:1788916963.882342:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140746240 00000100:00100000:0.0:1788916963.882356:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140746240 00000100:00100000:0.0:1788916963.882500:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140745984 00000100:00100000:1.0:1788916963.882528:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788916963.882542:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140746240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916963.882637:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140746240:12345-0@lo:400:kworker.0 Request processed in 100us (4296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916963.882644:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788916963.883546:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140746240:0@lo:400:kworker.0 00000100:00100000:0.0:1788916963.884275:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140745984 00000100:00080000:3.0:1788916963.884825:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788916963.884992:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788916963.885002:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140745984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916963.885096:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140745984:12345-0@lo:400:kworker.0 Request processed in 94us (6368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916963.885103:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788916963.885278:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140745984:0@lo:400:kworker.0 00010000:00010000:2.0:1788916964.127596:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916964.383936:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788916964.383959:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140746496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788916964.384048:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916964.384109:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140746496 00000100:00100000:2.0:1788916964.384117:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140746496 00000100:00100000:2.0:1788916964.384188:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788916964.384199:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140746496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788916964.384243:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788916964.384301:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140746496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916964.384323:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788916964.384418:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140746496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788916964.895914:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140746624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788916964.895984:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916964.896460:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140746624 00000100:00100000:1.0:1788916964.896469:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140746624 00000100:00100000:1.0:1788916964.896525:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788916964.896535:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140746624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788916964.896574:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916964.896624:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140746624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916964.896630:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788916964.896696:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2c991f80 x1875815140746624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916964.896716:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140746624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788916965.154633:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916965.773280:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916965.773333:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916965.773387:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916965.773429:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916965.773518:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113448064 00000100:00100000:2.0:1788916965.773529:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113448064 00000100:00100000:2.0:1788916965.773601:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113448320 00000100:00100000:2.0:1788916965.773605:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113448320 00000100:00100000:2.0:1788916965.773629:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 105 00000100:00100000:2.0:1788916965.773640:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2373:x1875815113448064:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788916965.773731:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2373:x1875815113448064:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 92us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916965.773739:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 105 00000100:00100000:2.0:1788916965.773768:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 106 00000100:00100000:2.0:1788916965.773776:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2373:x1875815113448320:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788916965.773812:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2373:x1875815113448320:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916965.773819:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 106 00000100:00100000:0.0:1788916965.774325:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113447936 00000100:00100000:0.0:1788916965.774333:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113447936 00000100:00100000:0.0:1788916965.774396:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 276 00000100:00100000:0.0:1788916965.774403:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:2373:x1875815113447936:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916965.774449:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:2373:x1875815113447936:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 47us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916965.774456:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 276 00000100:00080000:1.0:1788916965.774630:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788916965.775205:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113448192 00000100:00100000:3.0:1788916965.775214:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113448192 00000100:00100000:3.0:1788916965.775284:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:3.0:1788916965.775293:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2373:x1875815113448192:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788916965.775484:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2373:x1875815113448192:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 193us (2054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916965.775492:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00080000:1.0:1788916965.776141:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788916966.188712:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916967.199367:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916968.223340:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788916968.479875:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788916968.996034:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140747008:0@lo:400:kworker.0 00000100:00100000:1.0:1788916968.996125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916968.996220:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788916968.996227:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140747136:0@lo:400:kworker.0 00000100:00100000:1.0:1788916968.996254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916968.996293:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140747008 00000100:00100000:1.0:1788916968.996300:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140747008 00000100:00100000:1.0:1788916968.996356:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788916968.996365:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140747008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916968.996422:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140747008:12345-0@lo:400:kworker.0 Request processed in 58us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916968.996430:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788916968.996454:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140747136 00000100:00100000:1.0:1788916968.996458:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140747136 00000100:00080000:0.0:1788916968.996470:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788916968.996475:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788916968.996485:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788916968.996491:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140747136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916968.996521:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140747136:12345-0@lo:400:kworker.0 Request processed in 30us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916968.996523:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140747008:0@lo:400:kworker.0 00000100:00100000:1.0:1788916968.996527:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1788916968.996549:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e36db1500 x1875815140747136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916968.996551:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140746880:0@lo:400:kworker.0 00000100:00100000:0.0:1788916968.996559:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140747136:0@lo:400:kworker.0 00000100:00100000:1.0:1788916968.996612:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916968.996639:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28c2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140747392:0@lo:400:kworker.0 00000100:00100000:1.0:1788916968.996661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916968.996688:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140746880 00000100:00100000:0.0:1788916968.996692:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140746880 00000100:00100000:0.0:1788916968.996738:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788916968.996745:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140746880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916968.996781:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140746880:12345-0@lo:400:kworker.0 Request processed in 38us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916968.996787:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788916968.996812:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140747392 00000100:00100000:0.0:1788916968.996816:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140747392 00000100:00100000:0.0:1788916968.996846:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788916968.996852:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140747392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916968.996883:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140747392:12345-0@lo:400:kworker.0 Request processed in 31us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916968.996889:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788916968.996902:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788916968.996959:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140746752:0@lo:400:kworker.0 00000100:00100000:2.0:1788916968.996995:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916968.997032:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140747264:0@lo:400:kworker.0 00000100:00100000:2.0:1788916968.997056:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916968.997100:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140746752 00000100:00100000:0.0:1788916968.997104:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140746752 00000100:00100000:1.0:1788916968.997133:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28c2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140747392:0@lo:400:kworker.0 00000100:00100000:1.0:1788916968.997182:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140746880:0@lo:400:kworker.0 00000100:00100000:1.0:1788916968.997198:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140747264 00000100:00100000:0.0:1788916968.997201:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788916968.997206:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140747264 00000100:00100000:0.0:1788916968.997208:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140746752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916968.997234:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788916968.997240:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140747264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916968.997243:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140746752:12345-0@lo:400:kworker.0 Request processed in 36us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916968.997248:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788916968.997268:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140747264:12345-0@lo:400:kworker.0 Request processed in 28us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916968.997280:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1788916968.997297:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788916968.998276:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140746752:0@lo:400:kworker.0 00000100:00100000:3.0:1788916968.998290:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140747264:0@lo:400:kworker.0 00010000:00010000:0.0:1788916969.247442:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916969.504725:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788916969.504750:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140747520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788916969.504825:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916969.505037:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140747520 00000100:00100000:3.0:1788916969.505045:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140747520 00000100:00100000:3.0:1788916969.505110:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788916969.505120:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140747520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788916969.505192:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788916969.505256:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140747520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916969.505263:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788916969.505462:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140747520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788916970.016083:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788916970.016109:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140747648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788916970.016205:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916970.016344:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140747648 00000100:00100000:3.0:1788916970.016353:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140747648 00000100:00100000:3.0:1788916970.016423:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788916970.016434:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140747648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788916970.016490:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788916970.016553:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140747648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916970.016561:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788916970.016688:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2c993800 x1875815140747648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788916970.016707:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140747648:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788916970.016915:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788916970.271348:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916970.889839:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916970.889926:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916970.890309:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113448576 00000100:00100000:0.0:1788916970.890319:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113448576 00000100:00100000:0.0:1788916970.890408:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 110 00000100:00100000:0.0:1788916970.890419:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2371:x1875815113448576:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916970.890493:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2371:x1875815113448576:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 76us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916970.890501:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 110 00000100:00080000:1.0:1788916970.890891:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788916970.890963:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113448448 00000100:00100000:3.0:1788916970.891324:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113448448 00000100:00100000:3.0:1788916970.891456:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 278 00000100:00100000:3.0:1788916970.891466:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:2371:x1875815113448448:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788916970.891522:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:2371:x1875815113448448:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 57us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916970.891529:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 278 00000100:00100000:2.0:1788916970.901465:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916970.901795:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916970.907689:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113448832 00000100:00100000:1.0:1788916970.907714:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113448832 00000100:00100000:1.0:1788916970.907837:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 111 00000100:00100000:1.0:1788916970.907850:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2372:x1875815113448832:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:0.0:1788916970.907882:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788916970.907952:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2372:x1875815113448832:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 105us (6496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916970.907960:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 111 00000100:00100000:3.0:1788916970.908275:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113448704 00000100:00100000:3.0:1788916970.908281:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113448704 00000100:00100000:3.0:1788916970.908391:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:3.0:1788916970.908399:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2372:x1875815113448704:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788916970.908433:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2372:x1875815113448704:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 35us (6639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916970.908440:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00080000:1.0:1788916970.908505:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788916971.297904:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916972.319419:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916973.343552:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916974.112985:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140747776:0@lo:400:kworker.0 00000100:00100000:3.0:1788916974.113082:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916974.113128:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140748288:0@lo:400:kworker.0 00000100:00100000:3.0:1788916974.113168:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916974.113187:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788916974.113191:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140747904:0@lo:400:kworker.0 00000100:00100000:3.0:1788916974.113209:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916974.113222:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140748416:0@lo:400:kworker.0 00000100:00100000:3.0:1788916974.113244:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916974.113438:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140747776 00000100:00100000:0.0:1788916974.113446:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140747776 00000100:00100000:0.0:1788916974.113503:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788916974.113512:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140747776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916974.113582:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140747776:12345-0@lo:400:kworker.0 Request processed in 71us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916974.113591:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788916974.113623:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140748288 00000100:00100000:0.0:1788916974.113627:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140748288 00000100:00100000:0.0:1788916974.113656:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140747904 00000100:00100000:0.0:1788916974.113659:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140747904 00000100:00100000:0.0:1788916974.113671:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788916974.113705:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140748288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916974.113739:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c993800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140748288:12345-0@lo:400:kworker.0 Request processed in 63us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916974.113745:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788916974.113758:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788916974.113769:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140747904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916974.113789:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140747904:12345-0@lo:400:kworker.0 Request processed in 21us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916974.113793:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788916974.113805:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140748416 00000100:00100000:0.0:1788916974.113808:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140748416 00000100:00100000:0.0:1788916974.113824:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788916974.113828:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c991f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140748416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916974.113846:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c991f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140748416:12345-0@lo:400:kworker.0 Request processed in 17us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916974.113849:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788916974.113858:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788916974.113862:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788916974.113924:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140747904:0@lo:400:kworker.0 00000100:00100000:1.0:1788916974.113931:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140748416:0@lo:400:kworker.0 00000100:00100000:1.0:1788916974.113936:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140747776:0@lo:400:kworker.0 00000100:00100000:1.0:1788916974.113940:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140748288:0@lo:400:kworker.0 00000100:00100000:2.0:1788916974.114046:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140748032:0@lo:400:kworker.0 00000100:00100000:2.0:1788916974.114079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916974.114107:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788916974.114114:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140748160:0@lo:400:kworker.0 00000100:00100000:2.0:1788916974.114135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916974.114205:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140748032 00000100:00100000:2.0:1788916974.114209:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140748032 00000100:00100000:2.0:1788916974.114237:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788916974.114244:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140748032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916974.114279:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140748032:12345-0@lo:400:kworker.0 Request processed in 36us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916974.114285:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1788916974.114378:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788916974.114423:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140748160 00000100:00100000:3.0:1788916974.114427:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140748160 00000100:00100000:3.0:1788916974.114462:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788916974.114469:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140748160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916974.114500:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140748160:12345-0@lo:400:kworker.0 Request processed in 33us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916974.114506:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1788916974.116219:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788916974.116271:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e36db0380 x1875815140748160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916974.116289:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140748160:0@lo:400:kworker.0 00000100:00100000:1.0:1788916974.116317:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140748032:0@lo:400:kworker.0 00010000:00010000:1.0:1788916974.367389:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916974.627383:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788916974.627413:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140748544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788916974.627507:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916974.627846:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140748544 00000100:00100000:3.0:1788916974.627856:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140748544 00000100:00100000:3.0:1788916974.627922:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788916974.627934:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140748544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788916974.627978:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788916974.628041:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140748544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916974.628049:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788916974.628165:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140748544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788916975.135969:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788916975.139225:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140748672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788916975.139327:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916975.142007:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140748672 00000100:00100000:3.0:1788916975.142026:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140748672 00000100:00100000:3.0:1788916975.142180:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788916975.142193:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140748672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788916975.142254:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788916975.142377:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140748672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 187us (3049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916975.142385:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788916975.142480:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e2c992a00 x1875815140748672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916975.142502:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140748672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788916975.391844:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916976.017614:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916976.017674:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916976.017761:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113448960 00000100:00100000:3.0:1788916976.017773:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113448960 00000100:00100000:3.0:1788916976.017835:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 280 00000100:00100000:3.0:1788916976.017845:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:2374:x1875815113448960:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788916976.017932:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:2374:x1875815113448960:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 89us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916976.017940:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 280 00000100:00100000:2.0:1788916976.018443:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113449088 00000100:00100000:2.0:1788916976.018449:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113449088 00000100:00100000:2.0:1788916976.018505:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:2.0:1788916976.018515:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2374:x1875815113449088:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788916976.018560:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2374:x1875815113449088:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 47us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916976.018567:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00080000:1.0:1788916976.018676:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788916976.032435:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916976.032823:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916976.032897:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113449344 00000100:00100000:2.0:1788916976.032907:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113449344 00000100:00100000:2.0:1788916976.032981:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:2.0:1788916976.033002:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2374:x1875815113449344:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788916976.033084:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2374:x1875815113449344:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 94us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916976.033091:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00080000:1.0:1788916976.033298:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788916976.033674:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113449216 00000100:00100000:0.0:1788916976.033680:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113449216 00000100:00100000:0.0:1788916976.033740:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:0.0:1788916976.033748:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2370:x1875815113449216:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:0.0:1788916976.033782:0:8068:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d878 00000100:00080000:0.0:1788916976.033791:0:8068:0:(import.c:65:import_set_state_nolock()) ffff9a6e3f7fa800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788916976.033837:0:8068:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1788916976.033937:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788916976.033991:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788916976.034178:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+2:2370:x1875815113449216:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 429us (1752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916976.034185:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00010000:00010000:0.0:1788916976.416729:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916977.439857:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788916977.765438:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9afe8ff0-67c2-4292-b970-4ecb57096cb4 00000020:00000080:3.0:1788916977.765449:0:7503:0:(genops.c:907:class_export_put()) final put ffff9a6e3f7fa000/9afe8ff0-67c2-4292-b970-4ecb57096cb4 00000020:00000080:0.0:1788916977.766350:0:38:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e3f7fa000/9afe8ff0-67c2-4292-b970-4ecb57096cb4 for lustre-OST0001 00000020:00000080:0.0:1788916977.766414:0:38:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e3f7fa800 for lustre-OST0001 00010000:00010000:0.0:1788916978.463553:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788916978.720005:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788916979.233074:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788916979.236818:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140748928:0@lo:400:kworker.0 00000100:00100000:3.0:1788916979.236895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916979.237102:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140748800:0@lo:400:kworker.0 00000100:00100000:3.0:1788916979.237134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916979.238826:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140748928 00000100:00100000:2.0:1788916979.238835:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140748928 00000100:00100000:2.0:1788916979.238886:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788916979.238896:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140748928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916979.238985:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140748928:12345-0@lo:400:kworker.0 Request processed in 91us (2091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916979.238992:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788916979.239035:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140749056:0@lo:400:kworker.0 00000100:00100000:2.0:1788916979.239069:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916979.239093:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788916979.239099:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140749184:0@lo:400:kworker.0 00000100:00100000:2.0:1788916979.239124:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916979.239165:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140749056 00000100:00100000:2.0:1788916979.239169:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140749056 00000100:00100000:2.0:1788916979.239198:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788916979.239204:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140749056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916979.239382:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140749440:0@lo:400:kworker.0 00000100:00100000:1.0:1788916979.239513:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140748800 00000100:00100000:1.0:1788916979.239519:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140748800 00000100:00100000:1.0:1788916979.239549:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788916979.239556:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140748800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916979.239996:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916979.240041:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140748928:0@lo:400:kworker.0 00000100:00100000:3.0:1788916979.240061:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788916979.240067:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140749312:0@lo:400:kworker.0 00000100:00100000:3.0:1788916979.240098:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916979.240123:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140749312 00000100:00100000:3.0:1788916979.240127:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140749312 00000100:00100000:3.0:1788916979.240174:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788916979.240180:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140749312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916979.240213:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140749312:12345-0@lo:400:kworker.0 Request processed in 33us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916979.240220:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788916979.240314:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140749184 00000100:00100000:0.0:1788916979.240318:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140749184 00000100:00100000:0.0:1788916979.240342:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140749440 00000100:00100000:0.0:1788916979.240354:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140749440 00000100:00100000:0.0:1788916979.240372:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788916979.240378:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140749184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916979.240411:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140749184:12345-0@lo:400:kworker.0 Request processed in 34us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916979.240417:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788916979.240428:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788916979.240433:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c991180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140749440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916979.240452:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c991180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140749440:12345-0@lo:400:kworker.0 Request processed in 19us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916979.240457:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788916979.240569:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140749312:0@lo:400:kworker.0 00000100:00100000:3.0:1788916979.240579:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140749440:0@lo:400:kworker.0 00000100:00100000:2.0:1788916979.241045:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140749056:12345-0@lo:400:kworker.0 Request processed in 1840us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916979.241063:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:2.0:1788916979.241083:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788916979.241087:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788916979.241090:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788916979.241109:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e13e1e300 x1875815140749184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788916995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788916979.241121:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140749184:0@lo:400:kworker.0 00000100:00100000:2.0:1788916979.241131:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140749056:0@lo:400:kworker.0 00000100:00100000:1.0:1788916979.242246:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140748800:12345-0@lo:400:kworker.0 Request processed in 2689us (5109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916979.242257:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788916979.242492:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140748800:0@lo:400:kworker.0 00000001:02000400:0.0:1788916979.462126:0:11703:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:22:57 (1788916977) 00010000:00010000:3.0:1788916979.490534:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916979.749608:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788916979.749644:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140749568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788916979.749731:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916979.749885:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140749568 00000100:00100000:3.0:1788916979.749894:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140749568 00000100:00100000:3.0:1788916979.749960:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788916979.749972:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140749568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788916979.750016:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788916979.750073:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140749568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916979.750081:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788916979.750196:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140749568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788916980.255450:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140749696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788916980.255529:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916980.256036:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140749696 00000100:00100000:3.0:1788916980.256052:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140749696 00000100:00100000:3.0:1788916980.256108:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788916980.256119:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140749696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788916980.256188:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788916980.256271:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140749696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916980.256278:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788916980.256560:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e13e1d180 x1875815140749696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788916996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788916980.256581:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140749696:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788916980.511873:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916980.535763:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916980.535857:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113449472 00000100:00100000:3.0:1788916980.535871:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113449472 00000100:00100000:3.0:1788916980.535969:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:3.0:1788916980.535983:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:10249:x1875815113449472:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788916980.536010:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916980.536043:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d943 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f4d6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.536140:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e400/0x51de7f756a83d94a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.536192:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e400/0x51de7f756a83d94a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.536218:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e400/0x51de7f756a83d94a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916980.536460:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788916980.536464:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788916980.536582:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e400/0x51de7f756a83d94a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.536609:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d943 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4d6 expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.536641:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e400/0x51de7f756a83d94a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4d6 expref: 6 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.536662:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788916980.536665:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788916980.536669:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e400, rc 0) 00000100:00100000:3.0:1788916980.536745:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:10249:x1875815113449472:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 767us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916980.536761:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00080000:2.0:1788916980.537237:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788916980.545139:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916980.545306:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113449600 00000100:00100000:3.0:1788916980.545316:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113449600 00000100:00100000:3.0:1788916980.545371:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:3.0:1788916980.545382:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:10250:x1875815113449600:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788916980.545405:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916980.545425:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d951 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f4dd expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.545496:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d958 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.545511:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d958 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.545524:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d958 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.545540:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d95f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.545548:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d95f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.545570:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d95f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.547562:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83d966 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.547581:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83d966 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.547591:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83d966 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916980.547694:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788916980.547699:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788916980.547780:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83d966 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.547794:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d958 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.547800:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d958 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.547806:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d958 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.547811:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916980.547815:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d958 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.547822:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d958 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.547856:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788916980.547860:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916980.547864:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d958 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.547871:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d958 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.547884:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d95f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.547890:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d95f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.547896:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d95f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.547901:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18ea00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916980.547903:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d95f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.547910:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d95f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.547918:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a6e02ceef00) 00010000:00010000:3.0:1788916980.547920:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916980.547923:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d95f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.549344:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d95f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.549421:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d951 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4dd expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.549438:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83d966 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4dd expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.549447:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6e02cee500) 00010000:00010000:3.0:1788916980.549450:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788916980.549453:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18fa00, rc 0) 00000100:00100000:3.0:1788916980.549540:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:10250:x1875815113449600:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 4159us (4409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916980.549550:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:1.0:1788916980.556670:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916980.556749:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113449856 00000100:00100000:3.0:1788916980.556760:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113449856 00000100:00100000:3.0:1788916980.556820:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:3.0:1788916980.556831:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:10250:x1875815113449856:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788916980.556868:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916980.556890:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83d96d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f4e4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.557005:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83d974 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.557020:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83d974 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916980.557032:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83d974 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.562595:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d97b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.562628:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d97b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.562642:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d97b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.563586:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d982 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.563600:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d982 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.563608:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d982 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916980.563691:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788916980.563915:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83d974 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.566422:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83d974 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.566432:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83d974 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.566438:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916980.566443:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83d974 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.566452:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83d974 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.566471:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6e02cee500) 00010000:00010000:2.0:1788916980.566474:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916980.566480:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83d974 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.566486:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83d974 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.566514:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d97b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.566520:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d97b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.566525:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d97b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.566530:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fc200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916980.566552:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d97b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.566559:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d97b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.566567:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a6e02f3c200) 00010000:00010000:2.0:1788916980.566569:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916980.566573:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d97b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.566579:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc200/0x51de7f756a83d97b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.567680:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83d96d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4e4 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.567709:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d982 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4e4 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916980.567717:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:2.0:1788916980.567720:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916980.567723:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e013fc000, rc 0) 00000100:00100000:2.0:1788916980.567814:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:10250:x1875815113449856:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 10983us (11154us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788916980.567824:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:1.0:1788916980.573522:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916980.573629:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113449984 00000100:00100000:2.0:1788916980.573641:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113449984 00000100:00100000:2.0:1788916980.573712:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:2.0:1788916980.573725:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:10250:x1875815113449984:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788916980.573901:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:10250:x1875815113449984:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 180us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916980.573909:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00000040:00080000:0.0:1788916980.773892:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788916981.130093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916981.130134:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916981.130867:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113450112 00000100:00100000:0.0:1788916981.130879:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113450112 00000100:00100000:0.0:1788916981.130985:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 282 00000100:00100000:0.0:1788916981.130997:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+13:2371:x1875815113450112:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916981.131092:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+13:2371:x1875815113450112:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 96us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916981.131102:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 282 00000100:00100000:0.0:1788916981.131167:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113450240 00000100:00100000:0.0:1788916981.131172:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113450240 00000100:00100000:0.0:1788916981.131244:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00100000:0.0:1788916981.131250:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2371:x1875815113450240:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916981.131285:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2371:x1875815113450240:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 36us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916981.131292:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00080000:0.0:1788916981.131426:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788916981.535524:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916982.175627:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916982.175896:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113450368 00000100:00100000:3.0:1788916982.175907:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113450368 00000100:00100000:3.0:1788916982.175968:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:3.0:1788916982.175978:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:10294:x1875815113450368:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788916982.176003:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916982.176026:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d990 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f4eb expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176099:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d997 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176114:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d997 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176127:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d997 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176140:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d99e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176169:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d99e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176175:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d99e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176515:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d997 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176523:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d997 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176542:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d997 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176548:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18ea00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916982.176553:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d997 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176561:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d997 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176572:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788916982.176575:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916982.176580:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d997 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176586:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83d997 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176597:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d99e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176613:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d99e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176619:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d99e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176630:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916982.176633:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d99e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176638:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d99e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176647:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a6e02ceea00) 00010000:00010000:3.0:1788916982.176649:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916982.176651:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d99e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176657:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83d99e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176953:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d990 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4eb expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176966:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788916982.176968:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916982.176972:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83d990 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4eb expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.176984:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f200, rc 0) 00000100:00100000:3.0:1788916982.177429:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:10294:x1875815113450368:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1449us (1807us total) trans 0 rc 301/301 00000100:00100000:3.0:1788916982.177438:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00080000:3.0:1788916982.177473:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788916982.182756:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916982.182828:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113450624 00000100:00100000:3.0:1788916982.182839:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113450624 00000100:00100000:3.0:1788916982.182894:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:3.0:1788916982.182903:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:10294:x1875815113450624:12345-192.168.202.40@tcp:36:lfs.0 00010000:00010000:3.0:1788916982.182995:0:8069:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916982.183031:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e400/0x51de7f756a83d94a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4d6 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.183049:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788916982.183059:0:8069:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788916982.183335:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d9a5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.183349:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d9a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.183360:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d9a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.183372:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d9ac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.183377:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d9ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.183381:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d9ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916982.184294:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1788916982.184309:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d9a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.184327:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d9a5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.184333:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d9a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.184340:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18fc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916982.184345:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d9a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.184353:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d9a5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.184367:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:3.0:1788916982.184370:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916982.184374:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d9a5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.184380:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d9a5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788916982.184397:0:8069:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002d8aa500 reply state 00000000d338ac40 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d9ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916982.184406:0:8069:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788916982.184526:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+10:10294:x1875815113450624:12345-192.168.202.40@tcp:36:lfs.0 Request processed in 1621us (1773us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788916982.184535:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 37 00010000:00010000:2.0:1788916982.189411:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d9ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.189431:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d9ac lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.189439:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d9ac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.189445:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916982.189451:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d9ac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.189459:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d9ac lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.189478:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a6e02ceeb00) 00010000:00010000:2.0:1788916982.189482:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916982.189487:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d9ac lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.189493:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83d9ac lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916982.278406:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916982.278512:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113450752 00000100:00100000:3.0:1788916982.278525:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113450752 00000100:00100000:3.0:1788916982.278630:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:3.0:1788916982.278643:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:10302:x1875815113450752:12345-192.168.202.40@tcp:101:lctl.0 00010000:00010000:3.0:1788916982.278672:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916982.278697:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d9b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f4f2 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.278769:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e400/0x51de7f756a83d9ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.278784:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e400/0x51de7f756a83d9ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.278796:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e400/0x51de7f756a83d9ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916982.278863:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788916982.278867:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788916982.278941:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e400/0x51de7f756a83d9ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.278971:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83d9b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4f2 expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.278991:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e400/0x51de7f756a83d9ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4f2 expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.279000:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:3.0:1788916982.279003:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788916982.279007:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e400, rc 0) 00000100:00100000:3.0:1788916982.279074:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+10:10302:x1875815113450752:12345-192.168.202.40@tcp:101:lctl.0 Request processed in 434us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916982.279088:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:3.0:1788916982.332439:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916982.337086:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113450880 00000100:00100000:1.0:1788916982.337106:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113450880 00000100:00100000:1.0:1788916982.337235:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:1.0:1788916982.337247:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+10:10308:x1875815113450880:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1788916982.337271:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916982.337296:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83d9c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f4f9 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337375:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83d9c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337391:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83d9c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337417:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83d9c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337433:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83d9cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337440:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83d9cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337447:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83d9cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337567:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab600/0x51de7f756a83d9d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337576:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab600/0x51de7f756a83d9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337583:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab600/0x51de7f756a83d9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788916982.337630:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1788916982.337635:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788916982.337674:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab600/0x51de7f756a83d9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337698:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83d9c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337704:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83d9c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337721:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83d9c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337726:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaa600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916982.337730:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83d9c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337739:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83d9c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337750:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:1.0:1788916982.337753:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788916982.337757:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83d9c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337763:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83d9c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337776:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83d9cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337782:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83d9cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337787:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83d9cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337793:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916982.337796:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83d9cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337812:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83d9cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337820:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a6e1959e800) 00010000:00010000:1.0:1788916982.337822:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788916982.337825:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83d9cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337831:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83d9cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337862:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83d9c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4f9 expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337876:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab600/0x51de7f756a83d9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4f9 expref: 11 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.337884:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:1.0:1788916982.337887:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788916982.337889:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeab600, rc 0) 00000100:00100000:1.0:1788916982.337963:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+11:10308:x1875815113450880:12345-192.168.202.40@tcp:101:bash.0 Request processed in 718us (5534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916982.337972:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:1.0:1788916982.344537:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916982.347578:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113451136 00000100:00100000:0.0:1788916982.347595:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113451136 00000100:00100000:0.0:1788916982.347752:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:0.0:1788916982.347765:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+11:10308:x1875815113451136:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1788916982.347791:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916982.347815:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83d9dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f500 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.349535:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d9e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.349558:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d9e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.349572:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d9e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.353610:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d9eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.353638:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d9eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.353653:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d9eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788916982.355014:0:5793:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788916982.356542:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83d9f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.356565:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83d9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.356578:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83d9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.356632:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d9e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.356639:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d9e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.356647:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d9e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.356653:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916982.356659:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d9e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.356666:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d9e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.356747:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:0.0:1788916982.356751:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916982.356757:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d9e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.356778:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83d9e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788916982.356794:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2064c27 reply state 0000000069ac5390 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d9eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916982.356804:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788916982.356841:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83d9dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f500 expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.356855:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83d9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f500 expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.356863:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e03d86f00) 00010000:00010000:0.0:1788916982.356865:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788916982.356867:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3000, rc 0) 00000100:00100000:0.0:1788916982.357042:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:10308:x1875815113451136:12345-192.168.202.40@tcp:101:bash.0 Request processed in 9278us (12512us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788916982.357052:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 40 00010000:00010000:2.0:1788916982.360946:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d9eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916982.360978:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1788916982.360982:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d9eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.360990:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d9eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.360997:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916982.361002:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d9eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.361010:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d9eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.361030:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e03d86600) 00010000:00010000:2.0:1788916982.361034:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916982.361039:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d9eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.361046:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83d9eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916982.361134:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113451264 00000100:00100000:1.0:1788916982.361169:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113451264 00000100:00100000:1.0:1788916982.361212:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:1.0:1788916982.361220:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2370:x1875815113451264:12345-192.168.202.40@tcp:8:bash.0 00010000:00080000:1.0:1788916982.361260:0:6592:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp t0 exp 0000000000000000 cur 378 last 0 00000020:00000080:1.0:1788916982.361305:0:6592:0:(genops.c:1407:class_connect()) connect: client 9afe8ff0-67c2-4292-b970-4ecb57096cb4, cookie 0x51de7f756a83da00 00002000:00100000:1.0:1788916982.361318:0:6592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9afe8ff0-67c2-4292-b970-4ecb57096cb4/ffff9a6e03d1c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371a ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788916982.361344:0:6592:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788916982.361589:0:6592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788916982.361627:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9a6e03d1e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788916982.361888:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2370:x1875815113451264:12345-192.168.202.40@tcp:8:bash.0 Request processed in 666us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916982.361896:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:3.0:1788916982.366752:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916982.366827:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113451392 00000100:00100000:0.0:1788916982.366838:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113451392 00000100:00100000:0.0:1788916982.366936:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:0.0:1788916982.366948:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:0:x1875815113451392:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1788916982.366969:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916982.366994:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83da07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f507 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788916982.367067:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788916982.367092:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1788916982.367098:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788916982.367109:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83da07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f507 expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.367131:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83da07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f507 expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.367143:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3e00, rc 0) 00000100:00100000:0.0:1788916982.367243:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:0:x1875815113451392:12345-192.168.202.40@tcp:101:bash.0 Request processed in 297us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916982.367251:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00080000:3.0:1788916982.367553:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788916982.372078:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916982.372406:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113451520 00000100:00100000:0.0:1788916982.372417:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113451520 00000100:00100000:0.0:1788916982.372474:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:0.0:1788916982.372484:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:10308:x1875815113451520:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1788916982.372506:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916982.372525:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83da0e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f50e expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.372555:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83da07 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f507 expref: 8 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.372577:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788916982.372581:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788916982.372585:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83da0e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f50e expref: 8 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.372636:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83da07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f507 expref: 8 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.372652:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83da07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f507 expref: 8 pid: 6593 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916982.372668:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8068:1875815140749824:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788916982.372977:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36fe6000 going to sleep for 11 seconds 00000100:00100000:1.0:1788916982.380639:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916982.381087:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113451648 00000100:00100000:3.0:1788916982.381098:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113451648 00010000:00010000:3.0:1788916982.381143:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83da07 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f507 expref: 9 pid: 6593 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916982.381232:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:3.0:1788916982.381244:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:2373:x1875815113451648:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788916982.381261:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916982.381285:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83da07 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f507 expref: 9 pid: 6593 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.381299:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83da07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f507 expref: 9 pid: 6593 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.381332:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788916982.381338:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788916982.381359:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83da0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f50e expref: 9 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.381370:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83da0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f50e expref: 9 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.381379:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83da07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f507 expref: 9 pid: 6593 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916982.381398:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8068:1875815140749824:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788916982.381434:0:5777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83da0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f50e expref: 8 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.381438:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83da0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f50e expref: 8 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.381459:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3200, rc 0) 00000100:00100000:3.0:1788916982.381462:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5777:1875815140749952:192.168.202.40@tcp:105: 00000100:00100000:0.0:1788916982.381510:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:10308:x1875815113451520:12345-192.168.202.40@tcp:101:bash.0 Request processed in 9027us (9449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916982.381522:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3730ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1788916982.381525:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1788916982.392808:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916982.392911:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113451904 00000100:00100000:2.0:1788916982.392921:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113451904 00000100:00100000:2.0:1788916982.392984:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:2.0:1788916982.392995:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+13:10308:x1875815113451904:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:2.0:1788916982.393387:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:10308:x1875815113451904:12345-192.168.202.40@tcp:35:bash.0 Request processed in 392us (588us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788916982.393396:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:1.0:1788916982.393586:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5777:1875815140749952:192.168.202.40@tcp:105: 00010000:00010000:1.0:1788916982.393629:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916982.393657:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2373:x1875815113451648:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 12417us (13029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916982.393668:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:1.0:1788916982.480799:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916982.480934:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113452160 00000100:00100000:3.0:1788916982.480944:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113452160 00000100:00100000:3.0:1788916982.481006:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:3.0:1788916982.481018:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:10318:x1875815113452160:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788916982.481042:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916982.481064:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f515 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916982.481235:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1788916982.481373:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f515 expref: 16 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.481390:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:3.0:1788916982.481393:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788916982.481398:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f515 expref: 16 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.481415:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18fc00, rc 0) 00000100:00100000:3.0:1788916982.481483:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+15:10318:x1875815113452160:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 468us (697us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1788916982.481516:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:2.0:1788916982.488756:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916982.489180:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113452416 00000100:00100000:3.0:1788916982.489191:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113452416 00000100:00100000:3.0:1788916982.489373:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:3.0:1788916982.489385:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+15:10318:x1875815113452416:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1788916982.489688:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:10318:x1875815113452416:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 304us (943us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788916982.489697:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00010000:00010000:0.0:1788916982.559445:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916982.569290:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916982.569422:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113452544 00000100:00100000:3.0:1788916982.569432:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113452544 00000100:00100000:3.0:1788916982.569489:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:3.0:1788916982.569497:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:10324:x1875815113452544:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788916982.569524:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916982.569546:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f51c expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.569631:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83da2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.569643:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83da2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.569652:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83da2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916982.569713:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1788916982.569717:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788916982.569747:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83da2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.569769:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f51c expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.569786:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83da2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f51c expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.569793:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:3.0:1788916982.569795:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788916982.569797:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f200, rc 0) 00000100:00100000:3.0:1788916982.569847:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+17:10324:x1875815113452544:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 351us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916982.569851:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:1.0:1788916982.574009:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916982.574099:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113452800 00000100:00100000:3.0:1788916982.574112:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113452800 00000100:00100000:3.0:1788916982.574212:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:3.0:1788916982.574220:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+17:10324:x1875815113452800:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788916982.574243:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916982.574264:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83da31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f523 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.574361:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83da38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.574376:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83da38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.574389:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83da38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916982.574414:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788916982.574520:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83da31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f523 expref: 20 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.574534:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83da38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f523 expref: 19 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.574540:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e03d86f00) 00010000:00010000:3.0:1788916982.574542:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788916982.574545:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18ea00, rc 0) 00000100:00100000:3.0:1788916982.574592:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:10324:x1875815113452800:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 374us (595us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788916982.574607:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:2.0:1788916982.577856:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916982.578665:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113452928 00000100:00100000:3.0:1788916982.578678:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113452928 00000100:00100000:3.0:1788916982.578743:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:3.0:1788916982.578754:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:2371:x1875815113452928:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788916982.578770:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916982.578797:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83da38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f523 expref: 19 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.578814:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e03d86f00) 00010000:00010000:3.0:1788916982.578821:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916982.578900:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:2371:x1875815113452928:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 148us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916982.578908:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:3.0:1788916982.580402:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916982.580466:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113453184 00000100:00100000:2.0:1788916982.580472:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113453184 00000100:00100000:2.0:1788916982.580623:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:2.0:1788916982.580634:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:10324:x1875815113453184:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788916982.580659:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916982.580680:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83da46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f52a expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.580778:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83da4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.580793:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83da4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.580804:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83da4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916982.580816:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788916982.580966:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83da46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f52a expref: 21 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.580987:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83da4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f52a expref: 20 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.580997:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e03d86f00) 00010000:00010000:2.0:1788916982.581000:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788916982.581002:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031c00, rc 0) 00000100:00100000:2.0:1788916982.581055:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:10324:x1875815113453184:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 424us (659us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788916982.581073:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:3.0:1788916982.584816:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916982.584904:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113453312 00000100:00100000:1.0:1788916982.584914:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113453312 00000100:00100000:1.0:1788916982.585021:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:1.0:1788916982.585033:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113453312:12345-192.168.202.40@tcp:1:lfs.0 00010000:00010000:1.0:1788916982.585074:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b883162/0x51de7f756a83da5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.585090:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83da0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f50e expref: 7 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.585108:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788916982.585111:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788916982.585115:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b883162/0x51de7f756a83da5b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.585174:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83da0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f50e expref: 7 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.585185:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83da0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f50e expref: 7 pid: 8068 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916982.585260:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d088700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1875815140750080:192.168.202.40@tcp:104: 00000100:00100000:1.0:1788916982.585344:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e096e3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788916982.588803:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d088700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1875815140750080:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788916982.588839:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b883162/0x51de7f756a83da5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916982.590056:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916982.590128:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113453440 00000100:00100000:2.0:1788916982.590138:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113453440 00002000:00100000:2.0:1788916982.590278:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9a6e2d08ad80 x1875815113453440/t0(0) o4->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:363/0 lens 504/0 e 0 to 0 dl 1788916993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788916982.590289:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e2d08ad80 with x1875815113453440 ext(0->12) 00010000:00010000:2.0:1788916982.590298:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83da0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f50e expref: 8 pid: 8068 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.590315:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83da0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f50e expref: 8 pid: 8068 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788916982.590322:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a6e2d08ad80 00000100:00100000:2.0:1788916982.590355:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:2.0:1788916982.590367:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2373:x1875815113453440:12345-192.168.202.40@tcp:4:lfs.0 00000001:00100000:0.0:1788916982.620021:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9afe8ff0-67c2-4292-b970-4ecb57096cb4 00000100:00100000:1.0:1788916982.620824:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:2373:x1875815113453440:12345-192.168.202.40@tcp:4:lfs.0 Request processed in 30453us (30765us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788916982.620842:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00002000:00100000:1.0:1788916982.620855:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9a6e2d08ad80 x1875815113453440/t4294967299(0) o4->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:363/0 lens 504/448 e 0 to 0 dl 1788916993 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788916982.620865:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e2d08ad80 with x1875815113453440 ext(0->12) 00010000:00010000:1.0:1788916982.620877:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83da0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f50e expref: 9 pid: 8068 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.620896:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83da0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f50e expref: 9 pid: 8068 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788916982.620914:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a6e2d08ad80 00000100:00100000:2.0:1788916982.623142:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916982.623558:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113453568 00000100:00100000:3.0:1788916982.623568:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113453568 00010000:00010000:3.0:1788916982.623624:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83da0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f50e expref: 9 pid: 8068 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916982.623665:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:3.0:1788916982.623676:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:2371:x1875815113453568:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788916982.623691:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788916982.623714:0:5778:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788916982.623716:0:5778:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788916981 00002000:00010000:3.0:1788916982.623719:0:5778:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788916981 00002000:00010000:3.0:1788916982.623722:0:5778:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788916981 00010000:00010000:3.0:1788916982.623729:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83da0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f50e expref: 9 pid: 8068 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.623742:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83da0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f50e expref: 9 pid: 8068 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.623766:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83da0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f50e expref: 9 pid: 8068 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.623803:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788916982.623808:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788916982.623814:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b883162/0x51de7f756a83da5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.623825:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b883162/0x51de7f756a83da5b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.623865:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916982.623917:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2371:x1875815113453568:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 242us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916982.623926:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 36 00010000:00010000:2.0:1788916982.624139:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b883162/0x51de7f756a83da5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.624178:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b883162/0x51de7f756a83da5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.624215:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b883162/0x51de7f756a83da5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.624237:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b883162/0x51de7f756a83da5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.624246:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b883162/0x51de7f756a83da5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.624254:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788916982.624258:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b883162/0x51de7f756a83da5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.624268:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b883162/0x51de7f756a83da5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.624284:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b883162/0x51de7f756a83da5b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.624291:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b883162/0x51de7f756a83da5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916982.624359:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113453312:12345-192.168.202.40@tcp:1:lfs.0 Request processed in 39328us (39550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916982.624368:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:2.0:1788916982.629103:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916982.629446:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113453824 00000100:00100000:0.0:1788916982.629456:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113453824 00000100:00100000:0.0:1788916982.629512:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:0.0:1788916982.629522:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:10324:x1875815113453824:12345-192.168.202.40@tcp:35:lfs.0 00000004:00010000:0.0:1788916982.629605:0:5795:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83da4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f52a expref: 20 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788916982.629902:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788916982.631634:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788916982.632402:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788916982.632483:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83da62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.632511:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83d9f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f500 expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.632523:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83da62 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.632569:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83d9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f500 expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.632589:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83d9f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f500 expref: 24 pid: 5793 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916982.632634:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5795:1875815140750208:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788916982.632733:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36fe63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916982.635801:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5795:1875815140750208:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788916982.635835:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83da62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916982.636386:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916982.637475:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113453952 00000100:00100000:1.0:1788916982.637484:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113453952 00010000:00010000:1.0:1788916982.637520:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83d9f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f500 expref: 25 pid: 5793 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916982.637555:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:1.0:1788916982.637566:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f627b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+25:2373:x1875815113453952:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788916982.637582:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916982.637590:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83d9f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f500 expref: 25 pid: 5793 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.637609:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83d9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f500 expref: 25 pid: 5793 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.637626:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83d9f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f500 expref: 25 pid: 5793 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.637638:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e03d86f00) 00010000:00010000:1.0:1788916982.637642:0:6606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83da62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.637649:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83da62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.637654:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83da62 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916982.637687:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788916982.637711:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83da62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.637719:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83da62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916982.637756:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f627b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+24:2373:x1875815113453952:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 191us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916982.637763:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 37 00000001:00080000:0.0:1788916982.637854:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788916982.638364:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788916982.638662:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5795:1875815140750336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788916982.638765:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916982.638802:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36fe6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788916982.639825:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140750336 00000100:00100000:1.0:1788916982.639835:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140750336 00000100:00100000:1.0:1788916982.639901:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788916982.639912:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1875815140750336:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788916982.640013:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1875815140750336:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 103us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916982.640021:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788916982.640141:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5795:1875815140750336:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788916982.641008:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788916982.641083:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36db0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5795:1875815140750464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788916982.641126:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788916982.641367:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788916982.641501:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140750464 00000100:00100000:1.0:1788916982.641508:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140750464 00000100:00100000:1.0:1788916982.641554:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788916982.641563:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1875815140750464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788916982.641778:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5795:x1875815140750464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 215us (651us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788916982.641786:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788916982.642421:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36fe63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916982.642453:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36db0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5795:1875815140750464:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788916982.642518:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788916982.642566:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83da62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.642585:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83da62 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.642594:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83da62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.642612:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916982.642617:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83da62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.642626:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83da62 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.642643:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e03d86f00) 00010000:00010000:0.0:1788916982.642646:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788916982.642652:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83da62 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916982.642659:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83da62 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788916982.642866:0:5795:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788916982.643121:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788916982.643135:0:5795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378674988198ns, next at 379674985833ns, rc = 0 00000001:00080000:0.0:1788916982.643181:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788916982.644617:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e03d86f00) 00010000:00010000:0.0:1788916982.644625:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788916982.644636:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83da4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f52a expref: 28 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916982.644965:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+27:10324:x1875815113453824:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 15442us (15868us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788916982.644975:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000020:00080000:0.0:1788916982.644982:0:5795:0:(tgt_main.c:816:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788916982.651446:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916982.651716:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113454080 00000100:00100000:3.0:1788916982.651726:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113454080 00000100:00100000:3.0:1788916982.651817:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:3.0:1788916982.651828:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+27:10324:x1875815113454080:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788916982.651858:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916982.651881:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83da69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f531 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.651958:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83da69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f531 expref: 28 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.651975:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83da69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f531 expref: 28 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.652010:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788916982.652014:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788916982.652017:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18ea00, rc 0) 00000100:00100000:3.0:1788916982.652084:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+28:10324:x1875815113454080:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 257us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916982.652091:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:3.0:1788916982.654843:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916982.654943:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113454336 00000100:00100000:2.0:1788916982.654954:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113454336 00000100:00100000:2.0:1788916982.655013:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:2.0:1788916982.655023:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e08cfd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+28:10324:x1875815113454336:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1788916982.655646:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e08cfd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:10324:x1875815113454336:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 622us (810us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788916982.655655:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:2.0:1788916982.726442:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916982.726722:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113454592 00000100:00100000:3.0:1788916982.726732:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113454592 00000100:00100000:3.0:1788916982.726809:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:3.0:1788916982.726820:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:10334:x1875815113454592:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788916982.726850:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916982.726874:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83da70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f538 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916982.727623:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1788916982.727787:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83da70 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f538 expref: 31 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.727806:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:3.0:1788916982.727809:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788916982.727815:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83da70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f538 expref: 31 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.727834:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e600, rc 0) 00000100:00100000:3.0:1788916982.728105:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f625500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+30:10334:x1875815113454592:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1286us (1677us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788916982.728130:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:1.0:1788916982.731997:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916982.732100:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113454720 00000100:00100000:0.0:1788916982.732111:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113454720 00000100:00100000:3.0:1788916982.732308:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:3.0:1788916982.732323:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+30:10334:x1875815113454720:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:3.0:1788916982.732414:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83da7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732433:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83da7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732446:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83da7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732463:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732470:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732478:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732585:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83da8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732593:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83da8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732611:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83da8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788916982.732662:0:8069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83da8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732698:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83da7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732704:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83da7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732711:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83da7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732718:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18ee00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916982.732722:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83da7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732730:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83da7e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732742:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:3.0:1788916982.732745:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916982.732750:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83da7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732756:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83da7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732771:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732778:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732784:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732796:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18fc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916982.732800:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732805:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732814:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e02ceea00) 00010000:00010000:3.0:1788916982.732817:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916982.732819:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732825:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732841:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83da8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732847:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83da8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732853:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83da8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732857:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916982.732860:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83da8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732866:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83da8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732881:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788916982.732883:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916982.732886:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83da8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.732891:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83da8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916982.732979:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+30:10334:x1875815113454720:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 659us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916982.732990:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:2.0:1788916982.736338:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916982.736542:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113454976 00000100:00100000:0.0:1788916982.736553:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113454976 00000100:00100000:0.0:1788916982.736623:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:0.0:1788916982.736635:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+30:10334:x1875815113454976:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1788916982.736944:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:10334:x1875815113454976:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 311us (619us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788916982.736953:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:2.0:1788916982.775003:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916982.775797:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113455232 00000100:00100000:3.0:1788916982.775808:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113455232 00000100:00100000:3.0:1788916982.775864:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:3.0:1788916982.775875:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:10337:x1875815113455232:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788916982.776126:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916982.776177:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83da93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f53f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776369:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776385:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776397:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776413:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83daa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776435:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83daa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776441:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83daa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776573:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83daa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776582:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83daa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776588:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83daa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916982.776608:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788916982.776711:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776720:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776726:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776732:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18fc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916982.776736:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776743:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776767:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:3.0:1788916982.776770:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916982.776775:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776780:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83da9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776797:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83daa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776803:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83daa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776808:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83daa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776812:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18ee00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916982.776815:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83daa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776820:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83daa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776826:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e02ceea00) 00010000:00010000:3.0:1788916982.776828:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916982.776831:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83daa1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.776836:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83daa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.777446:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83da93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f53f expref: 34 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.777464:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83daa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f53f expref: 33 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.777472:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788916982.777475:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788916982.777478:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e600, rc 0) 00000100:00100000:2.0:1788916982.777632:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+33:10337:x1875815113455232:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1757us (2639us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788916982.777643:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:1.0:1788916982.780947:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916982.781028:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113455360 00000100:00100000:3.0:1788916982.781040:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113455360 00000100:00100000:3.0:1788916982.781091:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:3.0:1788916982.781099:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+33:10337:x1875815113455360:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:3.0:1788916982.781183:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83dab6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.781205:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83dab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.781214:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83dab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.781239:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83dab6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.781246:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83dab6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.781253:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83dab6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.781272:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916982.781277:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83dab6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.781282:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83dab6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.781292:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788916982.781294:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788916982.781297:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83dab6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.781301:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83dab6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916982.781373:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+33:10337:x1875815113455360:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 273us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916982.781380:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:3.0:1788916982.783655:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916982.784117:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113455616 00000100:00100000:0.0:1788916982.784127:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113455616 00000100:00100000:0.0:1788916982.784450:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:0.0:1788916982.784462:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+33:10337:x1875815113455616:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1788916982.784721:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+34:10337:x1875815113455616:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 260us (1073us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788916982.784728:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000001:00080000:1.0:1788916982.898138:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000004:00080000:1.0:1788916982.898182:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788916982.898207:0:5814:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6e36fe6600 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788916982.898212:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e09e78e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e36fe6180 00000020:00080000:1.0:1788916982.898215:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e09e78f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e3f45c400 00000100:00100000:3.0:1788916982.898434:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788916982.898455:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140750592:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788916982.898536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916982.898614:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140750592 00000100:00100000:3.0:1788916982.898621:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140750592 00000100:00100000:3.0:1788916982.898663:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788916982.898671:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140750592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788916982.898699:0:6592:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788916982.898731:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa0b4f5, atime: 0x6aa0b4f5, ctime: 0x6aa0b4f5, blocks: 0x1 00010000:00010000:3.0:1788916982.898745:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83dabd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.898762:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=378s v=(0 0) 00010000:00010000:3.0:1788916982.898767:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788916982.898773:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83dabd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.898789:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83dabd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.898799:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83dabd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.898808:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83dabd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916982.898822:0:6592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:2.0:1788916982.899039:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788916982.899139:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:2.0:1788916982.899167:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788916982.899174:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83dabd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.899183:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e800 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788916982.899187:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83dabd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.899196:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83dabd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.899213:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83dabd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.899227:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83dabd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916982.899244:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916982.899246:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916982.899248:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916982.900378:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1875815140750592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1702us (1836us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788916982.900390:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:3.0:1788916982.900539:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6e28d61f80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788916982.900548:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140750592:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788916983.008712:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916983.008813:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113455872 00000100:00100000:0.0:1788916983.008825:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113455872 00000100:00100000:0.0:1788916983.008899:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:0.0:1788916983.008910:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+12:10368:x1875815113455872:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:0.0:1788916983.008937:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916983.008973:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83dac4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f546 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.009095:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dacb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.009110:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dacb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.009124:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dacb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788916983.009136:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788916983.009449:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83dac4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f546 expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.009468:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dacb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f546 expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.009477:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:0.0:1788916983.009480:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788916983.009484:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2800, rc 0) 00000100:00100000:0.0:1788916983.009544:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:10368:x1875815113455872:12345-192.168.202.40@tcp:101:cat.0 Request processed in 635us (843us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788916983.009551:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:1.0:1788916983.014494:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916983.014601:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113456128 00000100:00100000:2.0:1788916983.014612:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113456128 00000100:00100000:2.0:1788916983.014678:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:2.0:1788916983.014689:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:10368:x1875815113456128:12345-192.168.202.40@tcp:35:cat.0 00000100:00100000:2.0:1788916983.014997:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+15:10368:x1875815113456128:12345-192.168.202.40@tcp:35:cat.0 Request processed in 309us (512us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788916983.015005:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:0.0:1788916983.017100:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916983.017261:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113456256 00000100:00100000:3.0:1788916983.017271:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113456256 00000100:00100000:3.0:1788916983.017338:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:3.0:1788916983.017349:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e408e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+15:2374:x1875815113456256:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788916983.017366:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916983.017395:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dacb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f546 expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.017433:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788916983.017439:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916983.017496:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e408e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:2374:x1875815113456256:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 149us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916983.017504:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:1.0:1788916983.073487:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916983.073618:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113456512 00000100:00100000:3.0:1788916983.073629:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113456512 00000100:00100000:3.0:1788916983.073689:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:3.0:1788916983.073700:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:10374:x1875815113456512:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:3.0:1788916983.073729:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916983.073732:0:8069:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788916983.073761:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83da2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f51c expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.073783:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:3.0:1788916983.073788:0:8069:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788916983.073802:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83dad9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f54d expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.073920:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dae0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.073936:0:8069:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83daa8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f53f expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.073945:0:8069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dae0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.073992:0:8069:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83daa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f53f expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.074005:0:8069:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83daa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f53f expref: 14 pid: 5792 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916983.074020:0:8069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140750720:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788916983.074112:0:8069:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3730e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788916983.076205:0:8069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140750720:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788916983.076233:0:8069:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dae0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916983.077184:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916983.077263:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113456640 00000100:00100000:3.0:1788916983.077272:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113456640 00010000:00010000:3.0:1788916983.077307:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83daa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f53f expref: 15 pid: 5792 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916983.077344:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:3.0:1788916983.077353:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+15:2374:x1875815113456640:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788916983.077367:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916983.077374:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83daa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f53f expref: 15 pid: 5792 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.077386:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83daa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f53f expref: 15 pid: 5792 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.077426:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83daa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f53f expref: 15 pid: 5792 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.077442:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788916983.077447:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dae0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.077457:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dae0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.077464:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dae0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.077484:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916983.077540:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:2374:x1875815113456640:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 186us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916983.077548:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00010000:00010000:0.0:1788916983.077624:0:8069:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dae0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.077632:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dae0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788916983.077658:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788916983.077828:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83dad9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f54d expref: 15 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.077848:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dae0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f54d expref: 14 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.077857:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:0.0:1788916983.077859:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788916983.077862:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18ee00, rc 0) 00000100:00100000:0.0:1788916983.077887:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:10374:x1875815113456512:12345-192.168.202.40@tcp:101:dd.0 Request processed in 4189us (4412us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788916983.077894:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:2.0:1788916983.083003:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916983.083107:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113456896 00000100:00100000:0.0:1788916983.083117:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113456896 00000100:00100000:0.0:1788916983.083344:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:0.0:1788916983.083353:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:10374:x1875815113456896:12345-192.168.202.40@tcp:36:dd.0 00010000:00010000:0.0:1788916983.083645:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83daee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.083664:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83daee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.083673:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83daee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788916983.083714:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788916983.083746:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000097d59f4b reply state 00000000f3744f57 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83daee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916983.083752:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788916983.083860:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+17:10374:x1875815113456896:12345-192.168.202.40@tcp:36:dd.0 Request processed in 507us (867us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788916983.083868:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 52 00000020:00080000:0.0:1788916983.083873:0:5793:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788916983.086492:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83daee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.086509:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83daee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.086517:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83daee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.086524:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916983.086529:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83daee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.086537:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83daee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.086554:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:1.0:1788916983.086557:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788916983.086561:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83daee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.086568:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83daee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916983.286451:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916983.286621:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113457024 00000100:00100000:0.0:1788916983.286633:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113457024 00000100:00100000:0.0:1788916983.286701:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:0.0:1788916983.286712:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:10388:x1875815113457024:12345-192.168.202.40@tcp:101:stat.0 00010000:00010000:0.0:1788916983.286753:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916983.286777:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83daf5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f554 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.286852:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dafc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.286867:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dafc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.286878:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dafc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.287109:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.287118:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.287173:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.287553:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83db0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.287567:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dae0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f54d expref: 17 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.287575:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83db0a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.287625:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dae0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f54d expref: 17 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.287642:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dae0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f54d expref: 17 pid: 8069 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916983.287657:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1875815140750848:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788916983.288056:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cd93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916983.290955:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1875815140750848:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788916983.290993:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83db0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916983.291237:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916983.291331:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113457280 00000100:00100000:3.0:1788916983.291340:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113457280 00000100:00100000:3.0:1788916983.291468:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:3.0:1788916983.291479:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:5591:x1875815113457280:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788916983.291845:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:5591:x1875815113457280:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 367us (607us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788916983.291853:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:2.0:1788916983.295636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916983.295730:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113457408 00000100:00100000:3.0:1788916983.295748:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113457408 00010000:00010000:3.0:1788916983.295789:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dae0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f54d expref: 19 pid: 8069 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916983.295844:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:3.0:1788916983.295854:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f624000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:2373:x1875815113457408:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788916983.295872:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916983.295879:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dae0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f54d expref: 19 pid: 8069 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.296357:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dae0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f54d expref: 19 pid: 8069 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.296383:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dae0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f54d expref: 19 pid: 8069 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.296400:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788916983.296406:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83db0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.296415:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83db0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.296423:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83db0a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.296458:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916983.296518:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f624000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:2373:x1875815113457408:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 665us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916983.296527:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00010000:00010000:0.0:1788916983.296557:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83db0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296566:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83db0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788916983.296629:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788916983.296633:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788916983.296671:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83db0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296684:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83db0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296694:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dafc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296701:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dafc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296708:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dafc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296715:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916983.296719:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dafc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296727:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dafc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296737:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:0.0:1788916983.296740:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916983.296744:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dafc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296751:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dafc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296772:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296778:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296783:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296789:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916983.296792:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296797:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296805:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e03d86f00) 00010000:00010000:0.0:1788916983.296808:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916983.296810:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296815:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296854:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83daf5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f554 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296869:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83db0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f554 expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.296888:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:0.0:1788916983.296890:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788916983.296893:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3000, rc 0) 00000100:00100000:0.0:1788916983.296919:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+17:10388:x1875815113457024:12345-192.168.202.40@tcp:101:stat.0 Request processed in 10210us (10479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916983.296926:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:1.0:1788916983.347060:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916983.347202:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113457664 00000100:00100000:2.0:1788916983.347219:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113457664 00000100:00100000:2.0:1788916983.347293:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:2.0:1788916983.347306:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+17:10394:x1875815113457664:12345-192.168.202.40@tcp:36:truncate.0 00010000:00010000:2.0:1788916983.347409:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916983.347441:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83db0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f554 expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.347468:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:2.0:1788916983.347472:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788916983.347755:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83db11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.347768:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83db11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.347776:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83db11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788916983.347814:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788916983.347834:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003becb7e5 reply state 00000000fd4cf949 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83db11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916983.347841:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788916983.347949:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:10394:x1875815113457664:12345-192.168.202.40@tcp:36:truncate.0 Request processed in 645us (905us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788916983.347958:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00000020:00080000:2.0:1788916983.347964:0:5792:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788916983.352974:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83db11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.352993:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83db11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.353014:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83db11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.353019:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916983.353022:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83db11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.353028:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83db11 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.353042:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:1.0:1788916983.353044:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788916983.353047:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83db11 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.353051:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83db11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916983.487990:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916983.488228:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113457792 00000100:00100000:3.0:1788916983.488251:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113457792 00000100:00100000:3.0:1788916983.488316:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:3.0:1788916983.488327:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:10408:x1875815113457792:12345-192.168.202.40@tcp:101:stat.0 00010000:00010000:3.0:1788916983.488354:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916983.488375:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83db18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f55b expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.488450:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83db1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.488467:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83db1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.488479:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83db1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.488494:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83db26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.488501:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83db26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.488508:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83db26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.488902:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83db2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.488911:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83db2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.488918:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83db2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916983.488962:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788916983.488967:0:8069:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788916983.488990:0:8069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83db2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.489004:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83db2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.489013:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83db1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.489019:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83db1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.489026:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83db1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.489032:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916983.489035:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83db1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.489042:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83db1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.489054:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:3.0:1788916983.489057:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916983.489061:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83db1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.489067:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83db1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.489091:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83db26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.489096:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83db26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.489102:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83db26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.489108:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916983.489110:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83db26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.489116:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83db26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.489124:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e02ceea00) 00010000:00010000:3.0:1788916983.489126:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916983.489129:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83db26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.489135:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83db26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.489237:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83db18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f55b expref: 20 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.489251:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83db2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f55b expref: 19 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.489270:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788916983.489272:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788916983.489275:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18fc00, rc 0) 00000100:00100000:3.0:1788916983.489346:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:10408:x1875815113457792:12345-192.168.202.40@tcp:101:stat.0 Request processed in 1019us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916983.489354:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 55 00010000:00010000:0.0:1788916983.583728:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788916983.594097:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916983.594207:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113458048 00000100:00100000:0.0:1788916983.594218:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113458048 00000100:00100000:0.0:1788916983.594292:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:0.0:1788916983.594304:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:10418:x1875815113458048:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1788916983.594335:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916983.594361:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83db34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f562 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788916983.594870:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1788916983.595068:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83db34 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f562 expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.595084:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:0.0:1788916983.595086:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788916983.595091:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83db34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f562 expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.595105:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3400, rc 0) 00000100:00100000:0.0:1788916983.595476:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:10418:x1875815113458048:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1173us (1389us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788916983.595492:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:2.0:1788916983.599963:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916983.600185:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113458304 00000100:00100000:0.0:1788916983.600204:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113458304 00000100:00100000:0.0:1788916983.600258:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:0.0:1788916983.600268:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:10418:x1875815113458304:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1788916983.600952:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+21:10418:x1875815113458304:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 681us (993us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788916983.600963:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:3.0:1788916983.667801:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916983.668011:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113458560 00000100:00100000:0.0:1788916983.668020:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113458560 00000100:00100000:0.0:1788916983.668072:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:0.0:1788916983.668080:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+21:10424:x1875815113458560:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1788916983.668109:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916983.668129:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83db42 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f569 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.668271:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db49 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.668293:0:8069:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83db2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f55b expref: 22 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.668300:0:8069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db49 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.668334:0:8069:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83db2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f55b expref: 22 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.668368:0:8069:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83db2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f55b expref: 22 pid: 8069 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916983.668383:0:8069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140750976:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788916983.668526:0:8069:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cd90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916983.670381:0:8069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140750976:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788916983.670413:0:8069:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db49 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916983.673027:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916983.673407:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113458688 00000100:00100000:0.0:1788916983.673416:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113458688 00010000:00010000:0.0:1788916983.673454:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83db2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f55b expref: 23 pid: 8069 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916983.673502:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:0.0:1788916983.673512:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+23:2373:x1875815113458688:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788916983.673528:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788916983.673537:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83db2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f55b expref: 23 pid: 8069 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.673550:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83db2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f55b expref: 23 pid: 8069 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.673573:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83db2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f55b expref: 23 pid: 8069 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.673624:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:0.0:1788916983.673630:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db49 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.673639:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.673647:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db49 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.673684:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788916983.673741:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+22:2373:x1875815113458688:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 230us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916983.673748:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 40 00010000:00010000:3.0:1788916983.674073:0:8069:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.674082:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916983.674104:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788916983.674309:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83db42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f569 expref: 23 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.674323:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f569 expref: 22 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.674331:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788916983.674334:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788916983.674337:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3c00, rc 0) 00000100:00100000:3.0:1788916983.674377:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+22:10424:x1875815113458560:12345-192.168.202.40@tcp:101:bash.0 Request processed in 6296us (6583us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1788916983.674385:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:3.0:1788916983.677243:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916983.677363:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113458944 00000100:00100000:0.0:1788916983.677374:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113458944 00000100:00100000:0.0:1788916983.677438:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:0.0:1788916983.677449:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+22:10424:x1875815113458944:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:0.0:1788916983.677757:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83db57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.677772:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83db57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.677781:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83db57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788916983.677819:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788916983.677836:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000c6b13e3 reply state 0000000083883045 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83db57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916983.677856:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788916983.678199:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+25:10424:x1875815113458944:12345-192.168.202.40@tcp:36:bash.0 Request processed in 751us (967us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788916983.678207:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00000020:00080000:0.0:1788916983.678212:0:5793:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788916983.685229:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:1.0:1788916983.685279:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83db57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.685292:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83db57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.685300:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83db57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.685306:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916983.685312:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83db57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.685388:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83db57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.685405:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:1.0:1788916983.685408:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788916983.685414:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83db57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.685421:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83db57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916983.686039:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113459072 00000100:00100000:0.0:1788916983.686051:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113459072 00000100:00100000:0.0:1788916983.686195:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:0.0:1788916983.686207:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+24:10424:x1875815113459072:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1788916983.686231:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916983.686250:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83db5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f570 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.686349:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83db65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.686363:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db49 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f569 expref: 25 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.686372:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83db65 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.686406:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f569 expref: 25 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.686419:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db49 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f569 expref: 25 pid: 8069 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916983.686446:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1875815140751104:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788916983.686539:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cd9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788916983.689130:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916983.689247:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1875815140751104:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788916983.689279:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83db65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916983.689384:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113459200 00000100:00100000:1.0:1788916983.689392:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113459200 00010000:00010000:1.0:1788916983.689425:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db49 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f569 expref: 26 pid: 8069 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916983.689578:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:1.0:1788916983.689599:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+26:2373:x1875815113459200:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788916983.689619:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916983.689627:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db49 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f569 expref: 26 pid: 8069 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.689640:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f569 expref: 26 pid: 8069 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.689666:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83db49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f569 expref: 26 pid: 8069 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.689702:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:1.0:1788916983.689708:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83db65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.689718:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83db65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.689727:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83db65 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.689757:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916983.689827:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+25:2373:x1875815113459200:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 240us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916983.689836:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 41 00010000:00010000:0.0:1788916983.689891:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83db65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.689899:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83db65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788916983.689950:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788916983.689955:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788916983.689976:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83db65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.690007:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83db5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f570 expref: 25 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.690022:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83db65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f570 expref: 24 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.690030:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:0.0:1788916983.690033:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788916983.690035:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2c00, rc 0) 00000100:00100000:0.0:1788916983.690063:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+24:10424:x1875815113459072:12345-192.168.202.40@tcp:101:bash.0 Request processed in 3858us (4844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916983.690078:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:1.0:1788916983.693116:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916983.693225:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113459456 00000100:00100000:3.0:1788916983.693234:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113459456 00000100:00100000:3.0:1788916983.693285:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:3.0:1788916983.693296:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e08cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+24:10424:x1875815113459456:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:3.0:1788916983.693628:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e08cfcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+25:10424:x1875815113459456:12345-192.168.202.40@tcp:35:bash.0 Request processed in 333us (521us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788916983.693637:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:2.0:1788916983.774078:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916983.774456:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113459712 00000100:00100000:0.0:1788916983.774467:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113459712 00000100:00100000:0.0:1788916983.774605:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:0.0:1788916983.774617:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+25:10434:x1875815113459712:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1788916983.774651:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916983.774675:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83db6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f577 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788916983.774971:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1788916983.775675:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83db6c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f577 expref: 27 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.775821:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:0.0:1788916983.775826:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788916983.775831:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83db6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f577 expref: 27 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.775894:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3200, rc 0) 00000100:00100000:0.0:1788916983.776012:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+26:10434:x1875815113459712:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1397us (1942us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788916983.776023:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:2.0:1788916983.782998:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916983.783355:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113459840 00000100:00100000:3.0:1788916983.783366:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113459840 00000100:00100000:2.0:1788916983.783560:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:2.0:1788916983.783572:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+26:10434:x1875815113459840:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:2.0:1788916983.783670:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db7a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.783689:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.783702:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.783719:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.783726:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.783732:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784098:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83db88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784109:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83db88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784117:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83db88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788916983.784207:0:8069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83db88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784221:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784234:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db7a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784241:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784248:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916983.784252:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784260:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db7a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784273:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:2.0:1788916983.784276:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916983.784281:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784288:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784304:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784310:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784316:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784321:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00030e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916983.784332:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784339:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784347:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e02f3cf00) 00010000:00010000:2.0:1788916983.784350:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916983.784353:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784359:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784376:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83db88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784383:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83db88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784389:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83db88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784395:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00030000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916983.784398:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83db88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784403:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83db88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784410:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:2.0:1788916983.784413:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916983.784422:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83db88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.784428:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83db88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916983.784515:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+26:10434:x1875815113459840:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 944us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916983.784524:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:1.0:1788916983.789358:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916983.789411:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113460096 00000100:00100000:3.0:1788916983.789421:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113460096 00000100:00100000:3.0:1788916983.789478:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:3.0:1788916983.789489:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+26:10434:x1875815113460096:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1788916983.790098:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+27:10434:x1875815113460096:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 611us (747us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788916983.790104:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:1.0:1788916983.829656:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916983.830047:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113460352 00000100:00100000:3.0:1788916983.830059:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113460352 00000100:00100000:3.0:1788916983.830126:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:3.0:1788916983.830138:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+27:10437:x1875815113460352:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788916983.831054:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916983.831082:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83db8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f57e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.831205:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.831220:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.831232:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.831247:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.831254:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.831259:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.831783:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dba4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.831800:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.831806:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dba4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916983.831817:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788916983.832715:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.832729:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.832737:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.832743:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00030e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916983.832747:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.832755:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.832767:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:2.0:1788916983.832770:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916983.832775:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.832781:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83db96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.832797:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.832811:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.832817:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.832821:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916983.832824:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.832830:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.832837:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e02f3cf00) 00010000:00010000:2.0:1788916983.832840:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916983.832843:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.832848:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83db9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.834113:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83db8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f57e expref: 30 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.834138:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dba4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f57e expref: 29 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916983.834163:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:2.0:1788916983.834167:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788916983.834181:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031600, rc 0) 00000100:00100000:2.0:1788916983.834268:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:10437:x1875815113460352:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 4132us (4622us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788916983.834279:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:2.0:1788916983.841273:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916983.841349:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916983.841508:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113460480 00000100:00100000:1.0:1788916983.841519:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113460480 00000100:00100000:1.0:1788916983.841579:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:1.0:1788916983.841601:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:10437:x1875815113460480:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:1.0:1788916983.841682:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dbb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.841699:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dbb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.841711:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dbb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.841748:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dbb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.841755:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dbb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.841762:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dbb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.841769:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaba00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916983.841773:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dbb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.841780:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dbb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.841792:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:1.0:1788916983.841795:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788916983.841800:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dbb2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916983.841806:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dbb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916983.841902:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:10437:x1875815113460480:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 304us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916983.841910:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:3.0:1788916983.842347:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113460608 00000100:00100000:3.0:1788916983.842352:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113460608 00000100:00100000:3.0:1788916983.842391:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:3.0:1788916983.842399:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:2371:x1875815113460608:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788916983.842411:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916983.842438:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dba4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f57e expref: 29 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916983.842467:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788916983.842471:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916983.842509:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+28:2371:x1875815113460608:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 112us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916983.842517:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:2.0:1788916983.849872:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916983.850044:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113460864 00000100:00100000:0.0:1788916983.850055:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113460864 00000100:00100000:0.0:1788916983.850181:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:0.0:1788916983.850202:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+28:10437:x1875815113460864:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1788916983.850480:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:10437:x1875815113460864:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 290us (617us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788916983.850488:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:2.0:1788916983.996384:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916983.996489:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113461120 00000100:00100000:0.0:1788916983.996500:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113461120 00000100:00100000:0.0:1788916983.996566:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:0.0:1788916983.996577:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:10455:x1875815113461120:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:0.0:1788916983.996617:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916983.996639:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dbb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f585 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.996751:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dbc0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.996767:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dbc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.996779:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dbc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788916983.996791:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788916983.996937:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dbb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f585 expref: 32 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.996956:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dbc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f585 expref: 31 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916983.996965:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:0.0:1788916983.996980:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788916983.996984:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3e00, rc 0) 00000100:00100000:0.0:1788916983.997057:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:10455:x1875815113461120:12345-192.168.202.40@tcp:101:cat.0 Request processed in 482us (683us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788916983.997065:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:1.0:1788916984.025107:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916984.025320:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113461248 00000100:00100000:0.0:1788916984.025331:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113461248 00000100:00100000:0.0:1788916984.025408:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:0.0:1788916984.025419:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:10456:x1875815113461248:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1788916984.025449:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916984.025472:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dbce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f58c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.025550:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dbd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.025565:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.025577:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788916984.025815:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1788916984.025820:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788916984.025894:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.025923:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dbce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f58c expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.025953:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dbd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f58c expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.025962:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:0.0:1788916984.025964:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788916984.025968:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3a00, rc 0) 00000100:00100000:0.0:1788916984.026036:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+32:10456:x1875815113461248:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 619us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916984.026044:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00080000:3.0:1788916984.026121:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788916984.030795:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916984.030939:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113461632 00000100:00100000:3.0:1788916984.030949:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113461632 00000100:00100000:3.0:1788916984.031011:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:3.0:1788916984.031021:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+32:10456:x1875815113461632:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1788916984.031392:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+33:10456:x1875815113461632:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 371us (606us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788916984.031402:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:1.0:1788916984.033806:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916984.033933:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113461760 00000100:00100000:3.0:1788916984.033943:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113461760 00000100:00100000:3.0:1788916984.034015:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:3.0:1788916984.034026:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d088380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+33:10456:x1875815113461760:12345-192.168.202.40@tcp:103:lfs.0 00010000:00010000:3.0:1788916984.034043:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788916984.034071:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83db65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f570 expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916984.034098:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dbc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f585 expref: 32 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916984.034124:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83da69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f531 expref: 31 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916984.034133:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788916984.034143:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916984.034391:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d088380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+30:10456:x1875815113461760:12345-192.168.202.40@tcp:103:lfs.0 Request processed in 366us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916984.034398:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:1.0:1788916984.036255:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916984.036346:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113461888 00000100:00100000:2.0:1788916984.036354:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113461888 00000100:00100000:2.0:1788916984.036405:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:2.0:1788916984.036415:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+30:10456:x1875815113461888:12345-192.168.202.40@tcp:58:lfs.0 00010000:00010000:2.0:1788916984.036545:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dbdc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.036561:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dbdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.036571:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dbdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788916984.037211:0:5792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788916984.037406:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788916984.037472:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788916984.037574:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+30:10456:x1875815113461888:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 1158us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916984.037596:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:1.0:1788916984.064327:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916984.064531:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113462016 00000100:00100000:0.0:1788916984.064542:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113462016 00000100:00100000:0.0:1788916984.064643:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:0.0:1788916984.064654:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+30:10458:x1875815113462016:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1788916984.064677:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916984.064697:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dbe3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f593 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.064763:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dbea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.064776:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dbea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.064787:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dbea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.064801:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dbf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.064819:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dbf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.064826:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dbf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065101:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dbf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065110:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065118:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788916984.065182:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788916984.065186:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788916984.065205:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065216:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065225:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dbea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065232:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dbea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065239:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dbea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065254:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916984.065259:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dbea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065266:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dbea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065278:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:0.0:1788916984.065280:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916984.065285:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dbea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065291:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dbea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065302:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dbf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065308:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dbf1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065314:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dbf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065319:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916984.065322:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dbf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065327:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dbf1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065340:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e03d86f00) 00010000:00010000:0.0:1788916984.065343:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916984.065345:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dbf1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065351:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dbf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065377:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dbe3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f593 expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065389:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f593 expref: 31 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.065396:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:0.0:1788916984.065397:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788916984.065400:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2c00, rc 0) 00000100:00100000:0.0:1788916984.065456:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:10458:x1875815113462016:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 805us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916984.065464:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:3.0:1788916984.351413:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140751488:0@lo:400:kworker.0 00000100:00100000:3.0:1788916984.351484:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916984.351542:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788916984.351549:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140751360:0@lo:400:kworker.0 00000100:00100000:3.0:1788916984.351571:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916984.351600:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140751872:0@lo:400:kworker.0 00000100:00100000:3.0:1788916984.351627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916984.351665:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140751488 00000100:00100000:3.0:1788916984.351673:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140751488 00000100:00100000:3.0:1788916984.351728:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140751360 00000100:00100000:3.0:1788916984.351730:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140751360 00000100:00100000:3.0:1788916984.351744:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788916984.351750:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140751488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916984.351790:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140751488:12345-0@lo:400:kworker.0 Request processed in 40us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916984.351795:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788916984.351807:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788916984.351823:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140751360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916984.351843:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140751360:12345-0@lo:400:kworker.0 Request processed in 20us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916984.351847:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788916984.351860:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140751872 00000100:00100000:3.0:1788916984.351862:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140751872 00000100:00100000:3.0:1788916984.351879:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788916984.351882:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140751872:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788916984.352004:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788916984.352010:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788916984.352039:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140751360:0@lo:400:kworker.0 00000100:00100000:2.0:1788916984.352053:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140751488:0@lo:400:kworker.0 00000100:00100000:0.0:1788916984.352123:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140751232:0@lo:400:kworker.0 00000100:00100000:0.0:1788916984.352171:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916984.352197:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140751744:0@lo:400:kworker.0 00000100:00100000:0.0:1788916984.352212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916984.352224:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788916984.352228:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140751616:0@lo:400:kworker.0 00000100:00100000:0.0:1788916984.352249:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916984.352341:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140751232 00000100:00100000:2.0:1788916984.352344:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140751232 00000100:00100000:2.0:1788916984.352369:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788916984.352373:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140751232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916984.352404:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140751232:12345-0@lo:400:kworker.0 Request processed in 31us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916984.352408:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788916984.352429:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140751616 00000100:00100000:2.0:1788916984.352431:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140751616 00000100:00100000:2.0:1788916984.352448:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788916984.352451:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1875815140751616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916984.352469:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1875815140751616:12345-0@lo:400:kworker.0 Request processed in 18us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916984.352473:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1788916984.352483:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788916984.352494:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140751616:0@lo:400:kworker.0 00000100:00100000:2.0:1788916984.352499:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140751232:0@lo:400:kworker.0 00000100:00100000:2.0:1788916984.352517:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140751744 00000100:00100000:2.0:1788916984.352520:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140751744 00000100:00100000:2.0:1788916984.352543:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788916984.352550:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140751744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916984.352592:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140751744:12345-0@lo:400:kworker.0 Request processed in 32us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916984.352599:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1788916984.352619:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788916984.352634:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140751744:0@lo:400:kworker.0 00000100:00100000:3.0:1788916984.353041:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140751872:12345-0@lo:400:kworker.0 Request processed in 1156us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916984.353047:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788916984.355118:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140751872:0@lo:400:kworker.0 00010000:00010000:2.0:1788916984.607461:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788916984.758893:0:11855:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788916984.758904:0:11855:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788916984.758944:0:11855:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788916984.758950:0:11855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788916984.864887:0:11537:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788916984.864897:0:11537:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788916984.864964:0:11537:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788916984.864972:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788916984.865115:0:11537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd32300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1875815140752000:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788916984.865254:0:11537:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e0530b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788916984.865977:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140752128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788916984.866032:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916984.866130:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140752128 00000100:00100000:2.0:1788916984.866137:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140752128 00000100:00100000:1.0:1788916984.866761:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788916984.866773:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140752128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788916984.866814:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916984.866877:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140752128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916984.866884:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788916984.867054:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140752128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788916984.867260:0:11537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd32300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1875815140752000:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788916984.869878:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916984.869972:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113462144 00000100:00100000:3.0:1788916984.869981:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113462144 00000100:00100000:3.0:1788916984.870076:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:3.0:1788916984.870089:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:10470:x1875815113462144:12345-192.168.202.40@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788916984.870210:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:10470:x1875815113462144:12345-192.168.202.40@tcp:900:lhsmtool_posix.0 Request processed in 123us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916984.870229:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:1.0:1788916984.873143:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916984.873197:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113462272 00000100:00100000:2.0:1788916984.873209:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113462272 00000100:00100000:2.0:1788916984.873281:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:2.0:1788916984.873291:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:10470:x1875815113462272:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788916984.873326:0:8069:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788916984.873492:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:10470:x1875815113462272:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 201us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916984.873500:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:1.0:1788916984.886795:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916984.886866:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113462400 00000100:00100000:2.0:1788916984.886877:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113462400 00000100:00100000:2.0:1788916984.886932:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:2.0:1788916984.886941:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:10470:x1875815113462400:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788916984.887017:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83dbff lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887042:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83dbff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887054:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83dbff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887072:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83dc06 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887078:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83dc06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887085:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83dc06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887111:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dc0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887119:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dc0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887125:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dc0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916984.887200:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788916984.887204:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788916984.887216:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dc0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887226:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83dbff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887241:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83dbff lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887247:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83dbff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887252:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00030e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916984.887256:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83dbff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887263:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83dbff lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887273:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:2.0:1788916984.887276:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916984.887281:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83dbff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887287:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83dbff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887298:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83dc06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887303:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83dc06 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887308:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83dc06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887311:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916984.887318:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83dc06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887323:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83dc06 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887330:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9a6e02f3ce00) 00010000:00010000:2.0:1788916984.887332:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916984.887334:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83dc06 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887339:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83dc06 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887353:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dc0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887358:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dc0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887362:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dc0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887366:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916984.887368:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dc0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887373:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dc0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887378:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:2.0:1788916984.887380:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916984.887386:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dc0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.887391:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dc0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916984.887456:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:10470:x1875815113462400:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 Request processed in 515us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916984.887463:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:3.0:1788916984.894056:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916984.895294:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113462656 00000100:00100000:2.0:1788916984.895307:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113462656 00000100:00100000:2.0:1788916984.895364:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:2.0:1788916984.895375:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:10470:x1875815113462656:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788916984.895396:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916984.895417:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dc14 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f59a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.895524:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dc1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.895539:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dc1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.895551:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dc1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916984.895563:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788916984.895690:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dc1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.895698:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dc1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.895711:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dc1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.895717:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916984.895722:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dc1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.895730:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dc1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.895742:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:2.0:1788916984.895745:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788916984.895749:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dc1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.895756:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dc1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.895798:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dc14 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f59a expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.895809:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:2.0:1788916984.895811:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788916984.895815:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dc14 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f59a expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.895824:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031c00, rc 0) 00000100:00100000:2.0:1788916984.895899:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+32:10470:x1875815113462656:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 526us (1857us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788916984.895915:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:1.0:1788916984.909537:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916984.909617:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113462784 00000100:00100000:2.0:1788916984.909627:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113462784 00000100:00100000:2.0:1788916984.909721:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:2.0:1788916984.909733:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+32:10470:x1875815113462784:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788916984.909767:0:5793:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788916984.909874:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+32:10470:x1875815113462784:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 143us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916984.909882:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:0.0:1788916984.931285:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916984.933344:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113463040 00000100:00100000:2.0:1788916984.933360:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113463040 00000100:00100000:2.0:1788916984.933434:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:2.0:1788916984.933446:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3641b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+32:10470:x1875815113463040:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788916984.933468:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916984.933472:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788916984.933497:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dbd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f58c expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.933517:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:2.0:1788916984.933522:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788916984.933534:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dc29 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f5a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788916984.934333:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788916984.934609:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dc30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.934632:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dc30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.934644:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dc30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.934709:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dc29 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5a1 expref: 34 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.934731:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dc30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5a1 expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.934740:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6e02f3ce00) 00010000:00010000:2.0:1788916984.934743:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788916984.934746:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031200, rc 0) 00000100:00100000:2.0:1788916984.935031:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3641b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+33:10470:x1875815113463040:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 1585us (3753us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788916984.935041:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:3.0:1788916984.950127:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916984.950190:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113463296 00000100:00100000:0.0:1788916984.950211:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113463296 00000100:00100000:0.0:1788916984.950330:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:0.0:1788916984.950342:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+33:10470:x1875815113463296:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788916984.950411:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788916984.950449:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dc30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5a1 expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.950473:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6e02f3ce00) 00010000:00010000:0.0:1788916984.950484:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788916984.950511:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dc3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.950525:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dc3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.950533:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dc3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.951844:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dc45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7b38e922 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.951861:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dc45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b38e922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.951871:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dc45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b38e922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.953324:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dc3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.953335:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dc3e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.953342:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dc3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.953349:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916984.953353:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dc3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.953361:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dc3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.953375:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:0.0:1788916984.953378:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916984.953383:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dc3e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.953389:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dc3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.953401:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dc45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b38e922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.953408:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dc45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b38e922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.953414:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dc45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b38e922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.954303:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916984.954307:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dc45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b38e922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.954315:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dc45 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7b38e922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.954325:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7b38e922 (ffff9a6e03d86f00) 00010000:00010000:0.0:1788916984.954328:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916984.954330:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dc45 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7b38e922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.954336:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dc45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7b38e922 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916984.954511:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+32:10470:x1875815113463296:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 4167us (4393us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788916984.954521:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:1.0:1788916984.956511:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916984.956699:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113463424 00000100:00100000:0.0:1788916984.956709:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113463424 00000100:00100000:0.0:1788916984.956771:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 74 00000100:00100000:0.0:1788916984.956781:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+32:10470:x1875815113463424:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788916984.956802:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916984.956825:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83dc4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f5a8 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.956868:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dc53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.956893:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dc53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.956904:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dc53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.957011:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83dc4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5a8 expref: 34 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.957028:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dc53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5a8 expref: 33 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.957037:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:0.0:1788916984.957039:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788916984.957043:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2800, rc 0) 00000100:00100000:0.0:1788916984.957246:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+33:10470:x1875815113463424:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 465us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916984.957254:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 74 00000100:00100000:1.0:1788916984.959881:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916984.960119:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113463680 00000100:00100000:2.0:1788916984.960130:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113463680 00000100:00100000:2.0:1788916984.960413:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:2.0:1788916984.960424:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+33:10470:x1875815113463680:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788916984.960523:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dc5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.960541:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dc5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916984.960587:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dc5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788916984.960898:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1788916984.960910:0:5793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 380992763406ns, next at 381992759265ns, rc = 0 00000004:00010000:2.0:1788916984.961008:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021863807 reply state 00000000a70684e7 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dc5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916984.961017:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788916984.961138:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+35:10470:x1875815113463680:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 714us (1266us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1788916984.961167:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:3.0:1788916984.963241:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:1.0:1788916984.963340:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dc5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916984.963352:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dc5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916984.963360:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dc5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916984.963367:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916984.963371:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dc5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916984.963387:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dc5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916984.963406:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:1.0:1788916984.963409:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788916984.963414:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dc5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916984.963421:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dc5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916984.966706:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113463808 00000100:00100000:0.0:1788916984.966726:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113463808 00000100:00100000:0.0:1788916984.966798:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:0.0:1788916984.966809:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+34:10470:x1875815113463808:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788916984.966840:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916984.966862:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dc61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f5af expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.966928:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dc61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5af expref: 35 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.966958:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dc61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5af expref: 35 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916984.966979:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:0.0:1788916984.966982:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788916984.966986:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3c00, rc 0) 00000100:00100000:0.0:1788916984.967060:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+35:10470:x1875815113463808:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 252us (3825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916984.967067:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:1.0:1788916984.973080:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916984.973664:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113463936 00000100:00100000:2.0:1788916984.973676:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113463936 00000100:00100000:3.0:1788916984.973778:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:3.0:1788916984.973789:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2370:x1875815113463936:12345-192.168.202.40@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788916984.973825:0:6590:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp t0 exp 0000000000000000 cur 381 last 0 00000020:00000080:3.0:1788916984.973861:0:6590:0:(genops.c:1407:class_connect()) connect: client 9afe8ff0-67c2-4292-b970-4ecb57096cb4, cookie 0x51de7f756a83dc68 00002000:00100000:3.0:1788916984.973872:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9afe8ff0-67c2-4292-b970-4ecb57096cb4/ffff9a6e06d92800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371a ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788916984.973898:0:6590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788916984.974304:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788916984.974347:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9a6e06d96000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788916984.974426:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2370:x1875815113463936:12345-192.168.202.40@tcp:8:lhsmtool_posix.0 Request processed in 638us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916984.974434:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:0.0:1788916984.975960:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916984.976012:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113464064 00000100:00100000:2.0:1788916984.976023:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113464064 00000100:00100000:2.0:1788916984.976096:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:2.0:1788916984.976105:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:0:x1875815113464064:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788916984.976255:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788916985.025567:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1788916985.025599:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9afe8ff0-67c2-4292-b970-4ecb57096cb4 00000100:00100000:0.0:1788916985.025816:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:0:x1875815113464064:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 49704us (49853us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788916985.025828:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:1.0:1788916985.028034:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916985.028333:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113464320 00000100:00100000:3.0:1788916985.028344:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113464320 00000100:00100000:3.0:1788916985.028449:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:3.0:1788916985.028506:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+35:10470:x1875815113464320:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788916985.028766:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+36:10470:x1875815113464320:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 263us (738us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788916985.028774:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:1.0:1788916985.031560:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916985.031731:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113464576 00000100:00100000:0.0:1788916985.031743:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113464576 00000100:00100000:0.0:1788916985.031839:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:0.0:1788916985.031850:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+36:10470:x1875815113464576:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788916985.031978:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+36:10470:x1875815113464576:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 129us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916985.031985:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:1.0:1788916985.036321:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916985.036554:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113464704 00000100:00100000:3.0:1788916985.036563:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113464704 00000100:00100000:3.0:1788916985.036642:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:3.0:1788916985.036651:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+36:10470:x1875815113464704:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788916985.036672:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916985.036691:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83dc6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f5b6 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.036879:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dc76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.036895:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dc76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.036909:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dc76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916985.036958:0:8069:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788916985.036976:0:8069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dc76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.037006:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83dc6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5b6 expref: 38 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.037024:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dc76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5b6 expref: 37 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.037033:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:3.0:1788916985.037036:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788916985.037040:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18ee00, rc 0) 00000100:00100000:3.0:1788916985.037329:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+37:10470:x1875815113464704:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 461us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916985.037339:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:3.0:1788916985.041446:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916985.041535:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113464832 00000100:00100000:2.0:1788916985.041545:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113464832 00000100:00100000:2.0:1788916985.041644:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:2.0:1788916985.041656:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2373:x1875815113464832:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788916985.041678:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916985.041703:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e018071/0x51de7f756a83dc7d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f5bd expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788916985.041733:0:8068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0b4f8, blocks: 0x1 00010000:00010000:2.0:1788916985.041764:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=381s v=(0 0) 00010000:00010000:2.0:1788916985.041769:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788916985.041780:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e018071/0x51de7f756a83dc7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5bd expref: 6 pid: 8068 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.041801:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e018071/0x51de7f756a83dc7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5bd expref: 6 pid: 8068 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.041813:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031600, rc 0) 00000100:00100000:2.0:1788916985.041876:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2373:x1875815113464832:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 223us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916985.041883:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:1.0:1788916985.049252:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916985.049365:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113465088 00000100:00100000:2.0:1788916985.049374:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113465088 00000100:00100000:0.0:1788916985.049473:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:0.0:1788916985.049485:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+37:10470:x1875815113465088:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788916985.049617:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+37:10470:x1875815113465088:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 133us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916985.049640:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:1.0:1788916985.054441:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916985.054622:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113465216 00000100:00100000:3.0:1788916985.054633:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113465216 00000100:00100000:3.0:1788916985.054702:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:3.0:1788916985.054711:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:10470:x1875815113465216:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788916985.054728:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916985.054748:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cb284ef/0x51de7f756a83dc84 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f5c4 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.054774:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e018071/0x51de7f756a83dc7d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5bd expref: 7 pid: 8068 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.054781:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788916985.054785:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788916985.054788:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb284ef/0x51de7f756a83dc84 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5c4 expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.054813:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e018071/0x51de7f756a83dc7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5bd expref: 7 pid: 8068 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.054823:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e018071/0x51de7f756a83dc7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5bd expref: 7 pid: 8068 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916985.054835:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcbb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6593:1875815140752256:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788916985.054923:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3730e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788916985.061454:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916985.061530:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113465344 00000100:00100000:1.0:1788916985.061541:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113465344 00010000:00010000:1.0:1788916985.061595:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e018071/0x51de7f756a83dc7d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5bd expref: 8 pid: 8068 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916985.061642:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:1.0:1788916985.061653:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e408e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2374:x1875815113465344:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788916985.061669:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916985.061703:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e018071/0x51de7f756a83dc7d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5bd expref: 8 pid: 8068 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916985.061713:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e018071/0x51de7f756a83dc7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5bd expref: 8 pid: 8068 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916985.061736:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788916985.061740:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788916985.061746:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002cb284ef/0x51de7f756a83dc84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5c4 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916985.061754:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb284ef/0x51de7f756a83dc84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5c4 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916985.061784:0:5779:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002cb284ef/0x51de7f756a83dc84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5c4 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916985.061795:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e03856300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5779:1875815140752384:192.168.202.40@tcp:105: 00000100:00100000:1.0:1788916985.061869:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06db6480 going to sleep for 11 seconds 00010000:00010000:3.0:1788916985.062485:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e018071/0x51de7f756a83dc7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5bd expref: 8 pid: 8068 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916985.062506:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcbb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6593:1875815140752256:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788916985.062545:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002cb284ef/0x51de7f756a83dc84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5c4 expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.062558:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18ea00, rc 0) 00000100:00100000:3.0:1788916985.062655:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:10470:x1875815113465216:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 7943us (8223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916985.062663:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:1.0:1788916985.065437:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e03856300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5779:1875815140752384:192.168.202.40@tcp:105: 00010000:00010000:1.0:1788916985.065463:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916985.065560:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e408e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2374:x1875815113465344:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 3908us (4116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916985.065572:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:1.0:1788916985.069859:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916985.069976:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113465472 00000100:00100000:2.0:1788916985.069987:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113465472 00002000:00100000:2.0:1788916985.070038:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9a6e03856300 x1875815113465472/t0(0) o4->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:366/0 lens 504/0 e 0 to 0 dl 1788916996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788916985.070050:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e03856300 with x1875815113465472 ext(0->8) 00002000:00010000:2.0:1788916985.070056:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6e03856300 00000100:00100000:2.0:1788916985.070089:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:2.0:1788916985.070099:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2373:x1875815113465472:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788916985.075926:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2373:x1875815113465472:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 Request processed in 5816us (6067us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788916985.075946:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00002000:00100000:3.0:1788916985.075958:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9a6e03856300 x1875815113465472/t4294967302(0) o4->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:366/0 lens 504/448 e 0 to 0 dl 1788916996 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788916985.075969:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e03856300 with x1875815113465472 ext(0->8) 00002000:00010000:3.0:1788916985.075975:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6e03856300 00000100:00100000:0.0:1788916985.097651:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916985.097750:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113465600 00000100:00100000:3.0:1788916985.097760:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113465600 00000100:00100000:3.0:1788916985.097857:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:3.0:1788916985.097868:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3641b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+37:10470:x1875815113465600:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788916985.153656:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3641b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+37:10470:x1875815113465600:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 Request processed in 55777us (56001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916985.153671:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 80 00000001:00080000:1.0:1788916985.153790:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:1.0:1788916985.153835:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1788916985.153841:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788916985.153894:0:5814:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1788916985.153907:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:2.0:1788916985.154627:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1788916985.154639:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788916985.154695:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788916985.154716:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140752512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788916985.154779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916985.155025:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140752512 00000100:00100000:3.0:1788916985.155033:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140752512 00000100:00100000:3.0:1788916985.155085:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788916985.155095:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3641a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140752512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788916985.155322:0:6590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788916985.155327:0:6590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788916984 00002000:00010000:3.0:1788916985.155329:0:6590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788916985.155331:0:6590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788916984 -> 1788916984 00002000:00010000:3.0:1788916985.155334:0:6590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788916985.155381:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3641a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140752512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 288us (602us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788916985.155388:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1788916985.155507:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6e3fcbb100/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788916985.155513:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140752512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788916985.157950:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916985.158227:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113465728 00000100:00100000:2.0:1788916985.158236:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113465728 00000100:00100000:2.0:1788916985.158311:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:2.0:1788916985.158322:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2374:x1875815113465728:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788916985.187512:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1788916985.187532:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1788916985.187728:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36419500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2374:x1875815113465728:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 Request processed in 29397us (29777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916985.187743:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:1.0:1788916985.191633:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916985.191767:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113465984 00000100:00100000:0.0:1788916985.191780:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113465984 00000100:00100000:0.0:1788916985.191902:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:0.0:1788916985.191917:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+13:10470:x1875815113465984:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788916985.191998:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788916985.192035:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83dc76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5b6 expref: 13 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.192057:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:0.0:1788916985.192063:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788916985.192102:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dc8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.192130:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dc8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.192141:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dc8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788916985.192507:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a1442da reply state 00000000d362c5fe transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dc8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916985.192517:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788916985.192693:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:10470:x1875815113465984:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 780us (1070us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788916985.192701:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 81 00010000:00010000:2.0:1788916985.194488:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dc8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.194506:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dc8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.194514:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dc8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.194521:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916985.194525:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dc8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.194532:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dc8b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.194549:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:2.0:1788916985.194553:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916985.194557:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dc8b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.194562:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dc8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916985.196088:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916985.196465:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113466112 00000100:00100000:3.0:1788916985.196477:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113466112 00000100:00100000:3.0:1788916985.196543:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:3.0:1788916985.196554:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2371:x1875815113466112:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788916985.196843:0:6590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788916985.196847:0:6590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788916984 -> 1788916982 00002000:00010000:3.0:1788916985.196850:0:6590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788916981 00002000:00010000:3.0:1788916985.196852:0:6590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788916984 -> 1788916982 00002000:00010000:3.0:1788916985.196855:0:6590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788916985.196927:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03857800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2371:x1875815113466112:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 375us (850us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788916985.196936:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:1.0:1788916985.202393:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916985.202533:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113466368 00000100:00100000:0.0:1788916985.202544:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113466368 00000100:00100000:0.0:1788916985.202615:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00100000:0.0:1788916985.202626:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+13:10470:x1875815113466368:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788916985.202711:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dc92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.202730:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dc53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5a8 expref: 13 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.202740:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dc92 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.202779:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dc53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5a8 expref: 13 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.202793:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dc53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5a8 expref: 13 pid: 8069 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916985.202808:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36418380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1875815140752640:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788916985.203003:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e02b9bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788916985.210636:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916985.211179:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113466496 00000100:00100000:1.0:1788916985.211191:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113466496 00010000:00010000:1.0:1788916985.211236:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dc53 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5a8 expref: 14 pid: 8069 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916985.211312:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:1.0:1788916985.211323:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:2374:x1875815113466496:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788916985.211341:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916985.211347:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dc53 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5a8 expref: 14 pid: 8069 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916985.211361:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dc53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5a8 expref: 14 pid: 8069 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916985.211384:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:1.0:1788916985.211390:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dc92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916985.211400:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dc92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916985.211426:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dc92 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916985.211445:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916985.211519:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:2374:x1875815113466496:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 197us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916985.211529:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 43 00010000:00010000:0.0:1788916985.213318:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dc53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5a8 expref: 13 pid: 8069 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916985.213350:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36418380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1875815140752640:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788916985.213387:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dc92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.213400:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dc92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.213406:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dc92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.213450:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dc92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.213458:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dc92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.213466:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dc92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.213473:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916985.213477:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dc92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.213486:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dc92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.213505:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:0.0:1788916985.213532:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788916985.213539:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dc92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.213545:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dc92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916985.213673:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+12:10470:x1875815113466368:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 Request processed in 11048us (11290us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788916985.213684:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00100000:2.0:1788916985.217379:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916985.217478:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113466624 00000100:00100000:3.0:1788916985.217491:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113466624 00000100:00100000:3.0:1788916985.217554:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:3.0:1788916985.217566:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113466624:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788916985.217637:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000044a4e65e/0x51de7f756a83dc99 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.217679:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002cb284ef/0x51de7f756a83dc84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5c4 expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.217688:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788916985.217693:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788916985.217699:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044a4e65e/0x51de7f756a83dc99 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.217742:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002cb284ef/0x51de7f756a83dc84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5c4 expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.217756:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002cb284ef/0x51de7f756a83dc84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5c4 expref: 7 pid: 6593 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916985.217771:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6593:1875815140752768:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788916985.217958:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3730e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788916985.223992:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916985.224141:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6593:1875815140752768:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788916985.224196:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000044a4e65e/0x51de7f756a83dc99 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916985.225232:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113466752 00000100:00100000:1.0:1788916985.225240:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113466752 00010000:00010000:1.0:1788916985.225282:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002cb284ef/0x51de7f756a83dc84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5c4 expref: 8 pid: 6593 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916985.225329:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:1.0:1788916985.225340:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2374:x1875815113466752:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788916985.225356:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916985.225383:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002cb284ef/0x51de7f756a83dc84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5c4 expref: 8 pid: 6593 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916985.225397:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002cb284ef/0x51de7f756a83dc84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5c4 expref: 8 pid: 6593 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916985.225420:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cb284ef/0x51de7f756a83dc84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5c4 expref: 8 pid: 6593 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916985.225436:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788916985.225440:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788916985.225462:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000044a4e65e/0x51de7f756a83dc99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916985.225472:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044a4e65e/0x51de7f756a83dc99 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916985.225508:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916985.225570:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113466752:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 232us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916985.225588:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00010000:00010000:0.0:1788916985.225667:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000044a4e65e/0x51de7f756a83dc99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.225676:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044a4e65e/0x51de7f756a83dc99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.225701:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000044a4e65e/0x51de7f756a83dc99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.225709:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044a4e65e/0x51de7f756a83dc99 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.225716:0:6593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044a4e65e/0x51de7f756a83dc99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.225724:0:6593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788916985.225728:0:6593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044a4e65e/0x51de7f756a83dc99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.225749:0:6593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044a4e65e/0x51de7f756a83dc99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.225761:0:6593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044a4e65e/0x51de7f756a83dc99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.225767:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044a4e65e/0x51de7f756a83dc99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916985.225817:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2374:x1875815113466624:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 Request processed in 8253us (8450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916985.225825:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:2.0:1788916985.228583:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916985.228671:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113467008 00000100:00100000:3.0:1788916985.228680:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113467008 00000100:00100000:3.0:1788916985.228741:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:3.0:1788916985.228751:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+12:10470:x1875815113467008:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788916985.228858:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dca0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.228877:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dca0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.228902:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dca0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.229540:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dca7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.229552:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dc61 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5af expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.229560:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dca7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.229624:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dc61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5af expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.229639:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dc61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5af expref: 13 pid: 5792 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916985.229655:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd31500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1875815140752896:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788916985.229741:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e096e3900 going to sleep for 11 seconds 00000100:00100000:1.0:1788916985.233230:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd31500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1875815140752896:192.168.202.40@tcp:104: 00010000:00010000:1.0:1788916985.233260:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dca7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916985.233841:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916985.234592:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113467136 00000100:00100000:3.0:1788916985.234602:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113467136 00010000:00010000:3.0:1788916985.234657:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dc61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5af expref: 14 pid: 5792 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916985.234706:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:3.0:1788916985.234718:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:2373:x1875815113467136:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788916985.234739:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916985.234747:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dc61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5af expref: 14 pid: 5792 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.234761:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dc61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5af expref: 14 pid: 5792 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.234785:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dc61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5af expref: 14 pid: 5792 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.234803:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:3.0:1788916985.234808:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dca7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.234831:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dca7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.234840:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dca7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.234877:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788916985.235224:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dca7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.235233:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dca7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788916985.235426:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788916985.235592:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788916985.235638:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788916985.235717:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5794:1875815140753024:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788916985.235777:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916985.235809:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e0530b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788916985.235954:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140753024 00000100:00100000:0.0:1788916985.235960:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140753024 00000100:00100000:0.0:1788916985.236005:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788916985.236015:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1875815140753024:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788916985.236103:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1875815140753024:12345-0@lo:1000:mdt00_002.0 Request processed in 90us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916985.236111:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788916985.236297:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:2373:x1875815113467136:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 1578us (2456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916985.236305:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:2.0:1788916985.236592:0:5794:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788916985.236598:0:5794:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6e3fcbb100, transno 4294967303 00000100:00100000:2.0:1788916985.236616:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5794:1875815140753024:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788916985.239488:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788916985.239600:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5794:1875815140753152:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788916985.239679:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916985.239756:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36fe6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788916985.239863:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140753152 00000100:00100000:3.0:1788916985.239871:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140753152 00000100:00100000:2.0:1788916985.240912:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788916985.240924:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1875815140753152:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788916985.242285:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5794:x1875815140753152:12345-0@lo:1000:mdt00_002.0 Request processed in 1359us (2601us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788916985.242294:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788916985.242516:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5794:1875815140753152:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788916985.242560:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dca7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.242568:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dca7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.242602:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dca7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.242609:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916985.242614:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dca7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.242623:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dca7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.242641:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:0.0:1788916985.242643:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788916985.242647:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dca7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.242651:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dca7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.242689:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dbdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.242693:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dbdc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.242697:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dbdc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.242700:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00030000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916985.242701:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dbdc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.242712:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dbdc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.242717:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:0.0:1788916985.242719:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788916985.242720:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dbdc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.242724:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dbdc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.242761:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dcae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.242772:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dbf8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f593 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.242778:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dcae lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.242807:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f593 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.242818:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dbf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f593 expref: 16 pid: 5794 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916985.242831:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36418380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1875815140753280:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788916985.242912:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e02b9b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788916985.245200:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36418380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1875815140753280:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788916985.245242:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dcae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916985.245694:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916985.245880:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113467264 00000100:00100000:2.0:1788916985.245888:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113467264 00010000:00010000:2.0:1788916985.245928:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dbf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f593 expref: 17 pid: 5794 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916985.245966:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:2.0:1788916985.245975:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+17:2373:x1875815113467264:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788916985.245992:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916985.246000:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dbf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f593 expref: 17 pid: 5794 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.246011:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f593 expref: 17 pid: 5794 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.246041:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dbf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f593 expref: 17 pid: 5794 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.246056:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:2.0:1788916985.246061:0:6606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dcae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.246071:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dcae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916985.246079:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dcae lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.246226:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dcae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.246231:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dcae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.246241:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dcae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.246244:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dcae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.246249:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dcae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.246253:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916985.246257:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dcae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.246261:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dcae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.246267:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:0.0:1788916985.246269:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916985.246271:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dcae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.246275:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dcae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.246289:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dca0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.246293:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dca0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.246297:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dca0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.246300:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916985.246301:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dca0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.246305:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dca0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.246309:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:0.0:1788916985.246310:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788916985.246312:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dca0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.246315:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dca0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916985.246569:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:10470:x1875815113467008:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 17818us (18005us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1788916985.246588:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 83 00000020:00080000:0.0:1788916985.246593:0:5794:0:(tgt_main.c:816:tgt_ses_key_exit()) total 5 transactions per RPC 00010000:00010000:2.0:1788916985.246651:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788916985.246692:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+15:2373:x1875815113467264:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 717us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916985.246699:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00000040:00080000:0.0:1788916985.248184:0:11537:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788916985.248191:0:11537:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788916985.248242:0:11537:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788916985.248248:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788916985.249025:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916985.249100:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113467520 00000100:00100000:0.0:1788916985.249118:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113467520 00000100:00100000:0.0:1788916985.249223:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:0.0:1788916985.249234:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+15:10470:x1875815113467520:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788916985.249974:0:5795:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788916985.250092:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788916985.250138:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dcb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.250268:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dcb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.250356:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dcb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.250366:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dcb5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.250373:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dcb5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.250380:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dcb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916985.250449:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788916985.250557:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+17:10470:x1875815113467520:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 1322us (1535us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788916985.250567:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000020:00080000:0.0:1788916985.250579:0:5795:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788916985.251101:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788916985.251118:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dcb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.251126:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3a00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788916985.251130:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dcb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.251137:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dcb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.251187:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:3.0:1788916985.251190:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788916985.251195:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dcb5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.251201:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dcb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916985.251233:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916985.251235:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788916985.251237:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916985.379841:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140753408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788916985.380085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916985.380205:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140753408 00000100:00100000:1.0:1788916985.380213:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140753408 00000100:00100000:1.0:1788916985.380273:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788916985.380283:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875815140753408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788916985.380323:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788916985.382382:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875815140753408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2093us (2289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916985.382395:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788916985.382504:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140753408:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788916985.631448:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916986.249757:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916986.249808:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916986.249833:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916986.249843:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916986.249857:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916986.249889:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113467776 00000100:00100000:0.0:1788916986.249897:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113467776 00000100:00100000:0.0:1788916986.249943:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113468160 00000100:00100000:0.0:1788916986.249945:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113468160 00000100:00100000:0.0:1788916986.249963:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:0.0:1788916986.249970:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3641b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+17:2371:x1875815113467776:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916986.250035:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3641b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+17:2371:x1875815113467776:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 66us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916986.250040:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:0.0:1788916986.250053:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:0.0:1788916986.250057:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2372:x1875815113468160:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916986.250070:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2372:x1875815113468160:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 13us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916986.250074:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:0.0:1788916986.250086:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113467904 00000100:00100000:0.0:1788916986.250089:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113467904 00000100:00100000:0.0:1788916986.250104:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113468032 00000100:00100000:0.0:1788916986.250106:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113468032 00000100:00100000:0.0:1788916986.250133:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:0.0:1788916986.250139:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3641aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2372:x1875815113467904:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916986.250184:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3641aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2372:x1875815113467904:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 45us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916986.250191:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:0.0:1788916986.250203:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:0.0:1788916986.250208:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36419f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2371:x1875815113468032:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916986.250232:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36419f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2371:x1875815113468032:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916986.250237:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00080000:0.0:1788916986.250258:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788916986.250262:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788916986.250265:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788916986.250651:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113467648 00000100:00100000:3.0:1788916986.250656:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113467648 00000100:00100000:3.0:1788916986.250695:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 284 00000100:00100000:3.0:1788916986.250702:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:2372:x1875815113467648:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788916986.250745:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:2372:x1875815113467648:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 43us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916986.250752:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 284 00000040:00080000:1.0:1788916986.457912:0:11907:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788916986.457922:0:11907:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788916986.457955:0:11907:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788916986.457966:0:11907:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788916986.547169:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916986.547215:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113468416 00000100:00100000:3.0:1788916986.547225:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113468416 00000100:00100000:2.0:1788916986.547373:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:2.0:1788916986.547386:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+17:10487:x1875815113468416:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788916986.547409:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916986.547432:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83dcbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f5cb expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.547759:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83dcc3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.547776:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83dcc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.547794:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83dcc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916986.547808:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1788916986.549960:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83dcbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5cb expref: 20 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.550078:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83dcc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5cb expref: 19 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.550088:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:2.0:1788916986.550091:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788916986.550094:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031400, rc 0) 00000100:00100000:2.0:1788916986.550187:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:10487:x1875815113468416:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 2803us (3051us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788916986.550196:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:1.0:1788916986.555191:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916986.555223:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113468544 00000100:00100000:0.0:1788916986.555234:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113468544 00000100:00100000:0.0:1788916986.555347:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00100000:0.0:1788916986.555358:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:10487:x1875815113468544:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:0.0:1788916986.555441:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83dcd1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555459:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83dcd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555471:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83dcd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555487:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dcd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555500:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555506:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555800:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dcdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555809:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dcdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555816:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dcdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788916986.555859:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dcdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555873:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83dcd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555879:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83dcd1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555887:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83dcd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555893:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916986.555897:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83dcd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555906:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83dcd1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555925:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:0.0:1788916986.555928:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916986.555933:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83dcd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555940:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83dcd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555951:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555958:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dcd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555963:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dcd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555969:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916986.555972:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dcd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555978:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dcd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555986:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e03d86d00) 00010000:00010000:0.0:1788916986.555988:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916986.555991:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dcd8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.555997:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dcd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.556032:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dcdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.556039:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dcdf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.556045:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dcdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.556050:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916986.556053:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dcdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.556059:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dcdf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.556067:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e03d86200) 00010000:00010000:0.0:1788916986.556069:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916986.556072:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dcdf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.556078:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dcdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916986.556175:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:10487:x1875815113468544:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 817us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916986.556184:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00100000:0.0:1788916986.599685:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916986.600209:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113468800 00000100:00100000:1.0:1788916986.600219:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113468800 00000100:00100000:1.0:1788916986.600269:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:1.0:1788916986.600279:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3641ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:10490:x1875815113468800:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1788916986.600301:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916986.600325:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83dce6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f5d2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.600421:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dced lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.600436:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dced lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.600448:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dced lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.600461:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83dcf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.600469:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83dcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.600474:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83dcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.600827:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83dcfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.600837:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83dcfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.600852:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83dcfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788916986.600863:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788916986.600960:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dced lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.600968:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dced lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.600974:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dced lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.600981:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaba00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916986.600985:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dced lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.600994:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dced lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.601007:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:1.0:1788916986.601011:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788916986.601017:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dced lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.601023:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83dced lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.601035:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83dcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.601042:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83dcf4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.601055:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83dcf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.601060:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916986.601063:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83dcf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.601070:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83dcf4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.601077:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e1959e700) 00010000:00010000:1.0:1788916986.601080:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788916986.601082:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83dcf4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.601088:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83dcf4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.601130:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83dce6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5d2 expref: 22 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.601171:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83dcfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5d2 expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.601180:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e1959eb00) 00010000:00010000:1.0:1788916986.601182:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788916986.601185:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeaac00, rc 0) 00000100:00100000:1.0:1788916986.601256:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3641ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+21:10490:x1875815113468800:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 977us (1581us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788916986.601271:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:0.0:1788916986.605812:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916986.605895:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113468928 00000100:00100000:1.0:1788916986.605905:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113468928 00000100:00100000:1.0:1788916986.605964:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 87 00000100:00100000:1.0:1788916986.605973:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+21:10490:x1875815113468928:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:1.0:1788916986.606054:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83dd09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.606070:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83dd09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.606082:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83dd09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.606107:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83dd09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.606114:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83dd09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.606121:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83dd09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.606127:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaa400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916986.606131:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83dd09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.606138:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83dd09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.606173:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e1959eb00) 00010000:00010000:1.0:1788916986.606186:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788916986.606192:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83dd09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.606198:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83dd09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916986.606279:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+21:10490:x1875815113468928:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 306us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916986.606286:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 87 00000100:00100000:3.0:1788916986.608626:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916986.608662:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113469184 00000100:00100000:3.0:1788916986.608670:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113469184 00000100:00100000:3.0:1788916986.608719:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:3.0:1788916986.608730:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e08cfc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+21:10490:x1875815113469184:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1788916986.616681:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e08cfc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+22:10490:x1875815113469184:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 7941us (8049us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788916986.616697:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:2.0:1788916986.644918:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916986.644987:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113469440 00000100:00100000:0.0:1788916986.645079:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113469440 00000100:00100000:0.0:1788916986.645296:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:0.0:1788916986.645309:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+22:10011:x1875815113469440:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1788916986.645336:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916986.645360:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dd10 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f5d9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.645474:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dd17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.645491:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83dcfb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5d2 expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.645501:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dd17 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.645537:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83dcfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5d2 expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.645549:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83dcfb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5d2 expref: 23 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916986.645578:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36419180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1875815140753536:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788916986.645678:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788916986.648529:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36419180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1875815140753536:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788916986.648573:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dd17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916986.649280:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916986.650330:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113469568 00000100:00100000:3.0:1788916986.650344:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113469568 00010000:00010000:3.0:1788916986.650392:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83dcfb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5d2 expref: 24 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916986.650430:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:3.0:1788916986.650451:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36419180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+24:2374:x1875815113469568:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788916986.650467:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916986.650475:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83dcfb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5d2 expref: 24 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.650488:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83dcfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5d2 expref: 24 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.650511:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83dcfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5d2 expref: 24 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.650526:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e1959eb00) 00010000:00010000:3.0:1788916986.650531:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dd17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.650541:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dd17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.650548:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dd17 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.650591:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916986.650647:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36419180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+23:2374:x1875815113469568:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 197us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916986.650655:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 47 00010000:00010000:1.0:1788916986.651378:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dd17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.651387:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dd17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788916986.651409:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788916986.651586:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83dd10 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5d9 expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.651602:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dd17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5d9 expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.651610:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e1959eb00) 00010000:00010000:1.0:1788916986.651613:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788916986.651616:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2200, rc 0) 00000100:00100000:1.0:1788916986.651664:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+23:10011:x1875815113469440:12345-192.168.202.40@tcp:101:bash.0 Request processed in 6358us (6754us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788916986.651672:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 88 00010000:00010000:3.0:1788916986.655667:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916986.659822:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916986.659906:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113469824 00000100:00100000:2.0:1788916986.659916:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113469824 00000100:00100000:2.0:1788916986.659976:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:2.0:1788916986.659987:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+23:10011:x1875815113469824:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:2.0:1788916986.660298:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.660317:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.660329:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788916986.660393:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1788916986.660418:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e028f82 reply state 0000000032370d5b transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916986.660426:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788916986.660475:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1788916986.660585:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+27:10011:x1875815113469824:12345-192.168.202.40@tcp:36:bash.0 Request processed in 599us (772us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788916986.660593:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 89 00000020:00080000:2.0:1788916986.660598:0:5794:0:(tgt_main.c:816:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788916986.662636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916986.662701:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113469952 00000100:00100000:2.0:1788916986.662710:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113469952 00000100:00100000:2.0:1788916986.662770:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 90 00000100:00100000:2.0:1788916986.662780:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3641bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+27:10011:x1875815113469952:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1788916986.662804:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916986.662824:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dd2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f5e0 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.662881:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dd2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5e0 expref: 28 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.662895:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dd2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5e0 expref: 28 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.662914:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e1959eb00) 00010000:00010000:2.0:1788916986.662917:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788916986.662921:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031200, rc 0) 00000100:00100000:2.0:1788916986.662997:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3641bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+28:10011:x1875815113469952:12345-192.168.202.40@tcp:101:bash.0 Request processed in 218us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916986.663013:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 90 00010000:00010000:1.0:1788916986.663486:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.663505:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.663513:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.663520:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916986.663525:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.663533:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.663546:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e1959eb00) 00010000:00010000:1.0:1788916986.663549:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788916986.663553:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.663570:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916986.667101:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916986.667206:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113470080 00000100:00100000:0.0:1788916986.667217:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113470080 00000100:00100000:0.0:1788916986.667277:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:0.0:1788916986.667290:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:10011:x1875815113470080:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1788916986.667312:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916986.667336:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c92d7a2/0x51de7f756a83dd33 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f5e7 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788916986.667367:0:8068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa0b4f6, atime: 0x6aa0b4f5, ctime: 0x6aa0b4f6, blocks: 0xb 00010000:00010000:0.0:1788916986.667390:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=382s v=(0 0) 00010000:00010000:0.0:1788916986.667395:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788916986.667404:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c92d7a2/0x51de7f756a83dd33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5e7 expref: 7 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.667423:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004c92d7a2/0x51de7f756a83dd33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5e7 expref: 7 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.667436:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3400, rc 0) 00000100:00100000:0.0:1788916986.667492:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:10011:x1875815113470080:12345-192.168.202.40@tcp:101:bash.0 Request processed in 205us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916986.667499:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:3.0:1788916986.669044:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916986.669304:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113470208 00000100:00100000:1.0:1788916986.669312:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113470208 00002000:00010000:1.0:1788916986.669350:0:6596:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788916986.669355:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e3fcbb100 with x1875815113470208 ext(0->18446744073709551615) 00002000:00010000:1.0:1788916986.669366:0:6596:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6e3fcbb100. 00000100:00100000:1.0:1788916986.669399:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:1.0:1788916986.669409:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113470208:12345-192.168.202.40@tcp:10:bash.0 00002000:00010000:1.0:1788916986.669701:0:6596:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788916986.669718:0:6596:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788916982 -> 1788916985 00002000:00010000:1.0:1788916986.669721:0:6596:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788916981 -> 1788916981 00002000:00010000:1.0:1788916986.669723:0:6596:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788916982 -> 1788916985 00002000:00010000:1.0:1788916986.669725:0:6596:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788916986.669823:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2374:x1875815113470208:12345-192.168.202.40@tcp:10:bash.0 Request processed in 414us (784us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788916986.669832:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00002000:00010000:1.0:1788916986.669837:0:6596:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788916986.669840:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e3fcbb100 with x1875815113470208 ext(0->18446744073709551615) 00002000:00010000:1.0:1788916986.669844:0:6596:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6e3fcbb100. 00000100:00100000:1.0:1788916986.738048:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916986.738196:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113470336 00000100:00100000:2.0:1788916986.738206:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113470336 00000100:00100000:2.0:1788916986.738269:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 91 00000100:00100000:2.0:1788916986.738279:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+27:10504:x1875815113470336:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:2.0:1788916986.738361:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dd3a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.738380:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dd3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.738392:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dd3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.738406:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.738413:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.738420:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.738737:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.738747:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.738766:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788916986.738807:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.738818:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dd3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.738825:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dd3a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.738833:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dd3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.738840:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00030000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916986.738844:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dd3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.738853:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dd3a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.738865:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:2.0:1788916986.739010:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916986.739018:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dd3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.739026:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83dd3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.739042:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.739055:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.739061:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.739066:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916986.739069:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.739076:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.739085:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e02f3c500) 00010000:00010000:2.0:1788916986.739088:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916986.739090:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.739096:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dd41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.739118:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.739124:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.739130:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.739135:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916986.739302:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.739311:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.739320:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e1959eb00) 00010000:00010000:2.0:1788916986.739323:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916986.739327:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.739333:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916986.739588:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+27:10504:x1875815113470336:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 1308us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916986.739606:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 91 00000100:00100000:2.0:1788916986.768661:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916986.768782:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113470592 00000100:00100000:0.0:1788916986.768795:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113470592 00000100:00100000:0.0:1788916986.769107:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 92 00000100:00100000:0.0:1788916986.769119:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+27:10507:x1875815113470592:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1788916986.769186:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916986.769208:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dd4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f5ee expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769279:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd56 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769295:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769306:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769319:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769325:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769331:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769648:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dd64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769657:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dd64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769664:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dd64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788916986.769673:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788916986.769774:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769782:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd56 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769788:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769795:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916986.769798:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769806:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769818:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:0.0:1788916986.769821:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916986.769826:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769832:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769845:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769850:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769856:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.769861:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916986.769880:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.770085:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.770093:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e03d86f00) 00010000:00010000:0.0:1788916986.770096:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916986.770098:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.770104:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.770231:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dd4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5ee expref: 30 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.770246:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dd64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5ee expref: 29 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.770254:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e1959eb00) 00010000:00010000:0.0:1788916986.770256:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788916986.770259:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2800, rc 0) 00000100:00100000:0.0:1788916986.770336:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:10507:x1875815113470592:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1218us (1683us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1788916986.770345:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 92 00000100:00100000:1.0:1788916986.772484:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916986.772886:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113470720 00000100:00100000:2.0:1788916986.772897:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113470720 00000100:00100000:2.0:1788916986.772956:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 93 00000100:00100000:2.0:1788916986.772967:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:10507:x1875815113470720:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:2.0:1788916986.773038:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.773056:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dd17 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5d9 expref: 29 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.773066:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd72 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.773101:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dd17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5d9 expref: 29 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.773133:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dd17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5d9 expref: 29 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916986.773180:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd31880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1875815140753664:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788916986.773278:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36fe60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788916986.775042:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916986.775080:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd31880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1875815140753664:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788916986.775105:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916986.775204:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113470976 00000100:00100000:0.0:1788916986.775211:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113470976 00000100:00100000:0.0:1788916986.775299:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:0.0:1788916986.775310:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+30:5590:x1875815113470976:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788916986.775656:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:5590:x1875815113470976:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 346us (620us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788916986.775665:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1788916986.777957:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916986.778092:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113471104 00000100:00100000:1.0:1788916986.778101:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113471104 00010000:00010000:1.0:1788916986.778138:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dd17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5d9 expref: 31 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916986.778214:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:1.0:1788916986.778223:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:2374:x1875815113471104:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788916986.778236:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916986.778243:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dd17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5d9 expref: 31 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.778257:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dd17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5d9 expref: 31 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.778281:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dd17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5d9 expref: 31 pid: 5793 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.778310:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e1959eb00) 00010000:00010000:1.0:1788916986.778316:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.778324:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.778333:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd72 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916986.778362:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788916986.778386:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.778398:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916986.778415:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+30:2374:x1875815113471104:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 192us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916986.778423:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 48 00010000:00010000:2.0:1788916986.778533:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.778542:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.778550:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.778556:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916986.778573:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.778582:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.778663:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e1959eb00) 00010000:00010000:2.0:1788916986.778667:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788916986.778672:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.778680:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83dd72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916986.779746:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:10507:x1875815113470720:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 6776us (7265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916986.779758:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 93 00000100:00100000:2.0:1788916986.782626:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916986.782718:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113471360 00000100:00100000:3.0:1788916986.782730:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113471360 00000100:00100000:3.0:1788916986.782831:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:3.0:1788916986.782842:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:10507:x1875815113471360:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1788916986.783113:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+30:10507:x1875815113471360:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 272us (497us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788916986.783120:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:1.0:1788916986.850202:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916986.850293:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113471616 00000100:00100000:0.0:1788916986.850303:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113471616 00000100:00100000:0.0:1788916986.850367:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 94 00000100:00100000:0.0:1788916986.850378:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+30:10518:x1875815113471616:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:0.0:1788916986.850404:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916986.850426:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dd79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f5f5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.850549:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd80 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.850574:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.850585:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.850600:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.850607:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.850613:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.851099:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dd8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.851116:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dd8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.851124:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dd8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788916986.851135:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788916986.851791:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.851801:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd80 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.851808:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.851815:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916986.851819:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.851827:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.851841:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:3.0:1788916986.851844:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916986.851857:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.851864:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dd80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.851879:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.852338:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.852344:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.852349:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916986.852352:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.852358:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.852367:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e03d86f00) 00010000:00010000:3.0:1788916986.852369:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916986.852372:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.852377:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83dd87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.852432:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83dd79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5f5 expref: 33 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.852465:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dd8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5f5 expref: 32 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.852473:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e1959eb00) 00010000:00010000:3.0:1788916986.852475:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788916986.852477:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3c00, rc 0) 00000100:00100000:3.0:1788916986.852546:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+32:10518:x1875815113471616:12345-192.168.202.40@tcp:101:cat.0 Request processed in 2169us (2354us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788916986.852555:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 94 00000100:00100000:1.0:1788916986.858532:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916986.858699:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113471872 00000100:00100000:0.0:1788916986.858710:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113471872 00000100:00100000:0.0:1788916986.858772:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:0.0:1788916986.858782:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+32:10518:x1875815113471872:12345-192.168.202.40@tcp:35:cat.0 00000100:00100000:0.0:1788916986.859076:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+33:10518:x1875815113471872:12345-192.168.202.40@tcp:35:cat.0 Request processed in 295us (595us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788916986.859085:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:2.0:1788916986.876511:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916986.876612:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113472128 00000100:00100000:3.0:1788916986.876623:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113472128 00000100:00100000:3.0:1788916986.876686:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 95 00000100:00100000:3.0:1788916986.876696:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+33:10519:x1875815113472128:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:3.0:1788916986.876763:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788916986.876793:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dd8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5f5 expref: 33 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.876818:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83dd64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5ee expref: 32 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.876832:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83dd2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5e0 expref: 31 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.876848:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e1959eb00) 00010000:00010000:3.0:1788916986.876859:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788916986.876910:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83dd9c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.876925:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83dd9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.876937:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83dd9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.876954:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dda3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.876960:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dda3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.876967:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dda3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.877341:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ddaa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.877351:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ddaa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.877357:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ddaa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788916986.878780:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1788916986.878794:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382910647302ns, next at 383910643889ns, rc = 0 00010000:00010000:3.0:1788916986.878870:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ddb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.878898:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ddb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.878916:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ddb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.878924:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ddb1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.878930:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ddb1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.878936:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ddb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.878957:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788916986.878978:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ddaa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.878984:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ddaa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.878991:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ddaa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.878996:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18ea00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916986.879000:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ddaa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.879007:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ddaa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.879018:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceea00) 00010000:00010000:3.0:1788916986.879021:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788916986.879031:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ddaa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.879037:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ddaa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.879055:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83dd9c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.879061:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83dd9c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.879066:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83dd9c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.879072:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916986.879075:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83dd9c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.879080:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83dd9c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.879087:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:3.0:1788916986.879089:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916986.879092:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83dd9c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.879096:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83dd9c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788916986.879104:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d503b954 reply state 000000007a527b96 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dda3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916986.879122:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788916986.880297:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788916986.880308:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ddb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.880316:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788916986.880320:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ddb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.880329:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ddb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.880342:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a6e02ceea00) 00010000:00010000:2.0:1788916986.880345:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788916986.880349:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ddb1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.880356:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ddb1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.880387:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916986.880390:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916986.880391:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916986.881133:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+32:10519:x1875815113472128:12345-192.168.202.40@tcp:36:rm.0 Request processed in 4431us (4625us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788916986.882074:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 95 00010000:00010000:2.0:1788916986.887599:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dda3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.887615:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dda3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.887624:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dda3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.887630:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916986.887635:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dda3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.887643:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dda3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.887659:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e02ceee00) 00010000:00010000:2.0:1788916986.887662:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916986.887666:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dda3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.887672:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83dda3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916986.943646:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916986.943850:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113472384 00000100:00100000:0.0:1788916986.943860:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113472384 00000100:00100000:0.0:1788916986.943941:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 96 00000100:00100000:0.0:1788916986.943949:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:10525:x1875815113472384:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1788916986.943976:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916986.943999:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83ddb8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f5fc expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.944129:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83ddbf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.944141:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83ddbf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.944195:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83ddbf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.944207:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83ddc6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.944212:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83ddc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.944216:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83ddc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788916986.944695:0:8069:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788916986.946075:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83ddcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.946090:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83ddcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.946097:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83ddcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.946126:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83ddbf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.946130:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83ddbf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.946135:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83ddbf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.946139:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916986.946268:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83ddbf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.946277:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83ddbf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.946289:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:0.0:1788916986.946292:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916986.946296:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83ddbf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.946302:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83ddbf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788916986.946317:0:8069:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f67117d1 reply state 00000000566013c3 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83ddc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916986.946327:0:8069:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788916986.946362:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83ddb8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5fc expref: 34 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.946377:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83ddcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5fc expref: 33 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.946384:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86b00) 00010000:00010000:0.0:1788916986.946387:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788916986.946390:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3e00, rc 0) 00000100:00100000:0.0:1788916986.946461:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+34:10525:x1875815113472384:12345-192.168.202.40@tcp:101:bash.0 Request processed in 2512us (2823us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788916986.946471:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 96 00000100:00100000:1.0:1788916986.954394:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916986.955937:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113472512 00000100:00100000:0.0:1788916986.955952:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113472512 00000100:00100000:0.0:1788916986.956023:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:0.0:1788916986.956034:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2371:x1875815113472512:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1788916986.956053:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916986.956073:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6f5b824/0x51de7f756a83dddb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f603 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788916986.956099:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788916986.956121:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=382s v=(0 0) 00010000:00010000:0.0:1788916986.956126:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788916986.956133:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6f5b824/0x51de7f756a83dddb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f603 expref: 8 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.956175:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6f5b824/0x51de7f756a83dddb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f603 expref: 8 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.956186:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3a00, rc 0) 00000100:00100000:0.0:1788916986.956252:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2371:x1875815113472512:12345-192.168.202.40@tcp:101:bash.0 Request processed in 221us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916986.956259:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:1.0:1788916986.960006:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916986.960211:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113472640 00000100:00100000:0.0:1788916986.960223:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113472640 00000100:00100000:0.0:1788916986.960291:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:0.0:1788916986.960303:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:10525:x1875815113472640:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1788916986.960332:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916986.960361:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83ddc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.960367:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecafb3e0/0x51de7f756a83dde2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f60a expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.960381:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83ddc6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.960387:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83ddc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.960392:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916986.960397:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83ddc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.960402:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6f5b824/0x51de7f756a83dddb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f603 expref: 9 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.960405:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83ddc6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.960411:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788916986.960415:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788916986.960420:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecafb3e0/0x51de7f756a83dde2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f60a expref: 9 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.960421:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e03d86100) 00010000:00010000:2.0:1788916986.960424:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916986.960428:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83ddc6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916986.960434:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83ddc6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.960455:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6f5b824/0x51de7f756a83dddb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f603 expref: 9 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.960470:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6f5b824/0x51de7f756a83dddb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f603 expref: 9 pid: 6593 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916986.960486:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3641a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8068:1875815140753792:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788916986.960586:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788916986.964603:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916986.964697:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3641a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8068:1875815140753792:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788916986.964736:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ecafb3e0/0x51de7f756a83dde2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f60a expref: 9 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916986.964759:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2c00, rc 0) 00000100:00100000:0.0:1788916986.964838:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:10525:x1875815113472640:12345-192.168.202.40@tcp:101:bash.0 Request processed in 4538us (4846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916986.964876:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:3.0:1788916986.965980:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113472768 00000100:00100000:3.0:1788916986.965992:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113472768 00010000:00010000:3.0:1788916986.966035:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6f5b824/0x51de7f756a83dddb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f603 expref: 9 pid: 6593 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916986.966075:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:3.0:1788916986.966083:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e408e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:2373:x1875815113472768:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788916986.966097:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916986.966121:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6f5b824/0x51de7f756a83dddb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f603 expref: 9 pid: 6593 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.966134:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6f5b824/0x51de7f756a83dddb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f603 expref: 9 pid: 6593 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.966184:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6f5b824/0x51de7f756a83dddb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f603 expref: 9 pid: 6593 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.966201:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788916986.966205:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788916986.966213:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecafb3e0/0x51de7f756a83dde2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f60a expref: 8 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.966239:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecafb3e0/0x51de7f756a83dde2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f60a expref: 8 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916986.966275:0:5777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ecafb3e0/0x51de7f756a83dde2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f60a expref: 8 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916986.966289:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5777:1875815140753920:192.168.202.40@tcp:105: 00000100:00100000:3.0:1788916986.966356:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3730e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788916986.969449:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916986.969740:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113473024 00000100:00100000:0.0:1788916986.969752:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113473024 00000100:00100000:0.0:1788916986.969914:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:0.0:1788916986.969926:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+33:10525:x1875815113473024:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:0.0:1788916986.970283:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+34:10525:x1875815113473024:12345-192.168.202.40@tcp:35:bash.0 Request processed in 358us (843us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788916986.970292:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:3.0:1788916986.970499:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5777:1875815140753920:192.168.202.40@tcp:105: 00010000:00010000:3.0:1788916986.970524:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916986.970566:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e408e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2373:x1875815113472768:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 4475us (5965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916986.970577:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:1.0:1788916987.110700:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916987.110813:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113473152 00000100:00100000:2.0:1788916987.110824:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113473152 00000100:00100000:2.0:1788916987.110893:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 97 00000100:00100000:2.0:1788916987.110903:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+34:10541:x1875815113473152:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788916987.110928:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916987.110948:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dde9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f611 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.111042:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83ddf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.111058:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83ddf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.111071:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83ddf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916987.111136:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1788916987.111140:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788916987.111206:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83ddf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.111233:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83dde9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f611 expref: 36 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.111258:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83ddf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f611 expref: 35 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.111267:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:2.0:1788916987.111269:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788916987.111273:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00030000, rc 0) 00000100:00100000:2.0:1788916987.111343:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+35:10541:x1875815113473152:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 442us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916987.111350:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 97 00000100:00100000:1.0:1788916987.115716:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916987.115866:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113473408 00000100:00100000:3.0:1788916987.115877:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113473408 00000100:00100000:3.0:1788916987.115952:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 98 00000100:00100000:3.0:1788916987.115963:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+35:10541:x1875815113473408:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788916987.115987:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916987.116010:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ddf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f618 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.116129:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ddfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.116453:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ddfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.116480:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ddfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916987.116492:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788916987.118322:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ddf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f618 expref: 38 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.118367:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ddfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f618 expref: 37 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.118376:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86b00) 00010000:00010000:2.0:1788916987.118379:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788916987.118383:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18ea00, rc 0) 00000100:00100000:2.0:1788916987.118511:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+37:10541:x1875815113473408:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 2550us (2806us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788916987.118521:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 98 00000100:00100000:1.0:1788916987.121724:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916987.124096:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113473664 00000100:00100000:2.0:1788916987.124111:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113473664 00000100:00100000:2.0:1788916987.124258:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 99 00000100:00100000:2.0:1788916987.124270:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+37:10541:x1875815113473664:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788916987.124300:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916987.124323:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83de0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f61f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.124434:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83de13 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.124450:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83de13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.124462:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83de13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916987.124475:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788916987.124632:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83de0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f61f expref: 40 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.124653:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83de13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f61f expref: 39 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.124661:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86b00) 00010000:00010000:2.0:1788916987.124664:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788916987.124668:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00030e00, rc 0) 00000100:00100000:2.0:1788916987.125112:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+39:10541:x1875815113473664:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 844us (3396us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788916987.125120:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 99 00000100:00100000:1.0:1788916987.125376:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916987.129820:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916987.130051:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113473920 00000100:00100000:0.0:1788916987.130062:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113473920 00000100:00100000:0.0:1788916987.130121:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:0.0:1788916987.130130:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3b1c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2371:x1875815113473920:12345-192.168.202.40@tcp:1:lfs.0 00010000:00010000:0.0:1788916987.130212:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83de21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.130234:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecafb3e0/0x51de7f756a83dde2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f60a expref: 8 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.130242:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788916987.130247:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788916987.130252:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83de21 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.130288:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ecafb3e0/0x51de7f756a83dde2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f60a expref: 8 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.130324:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ecafb3e0/0x51de7f756a83dde2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f60a expref: 8 pid: 8068 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916987.130341:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3641a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1875815140754048:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788916987.130428:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788916987.131111:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113473792 00000100:00100000:2.0:1788916987.131118:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113473792 00000100:00100000:2.0:1788916987.131183:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:2.0:1788916987.131192:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f325500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+39:2371:x1875815113473792:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788916987.131204:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916987.131226:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ddfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f618 expref: 39 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.131243:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86b00) 00010000:00010000:2.0:1788916987.131248:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788916987.131285:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f325500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+38:2371:x1875815113473792:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 95us (5910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916987.131293:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:1.0:1788916987.135879:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916987.136017:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113474048 00000100:00100000:3.0:1788916987.136027:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113474048 00002000:00100000:3.0:1788916987.136081:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9a6e3f324380 x1875815113474048/t0(0) o4->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:368/0 lens 504/0 e 0 to 0 dl 1788916998 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788916987.136092:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e3f324380 with x1875815113474048 ext(0->8) 00010000:00010000:3.0:1788916987.136102:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ecafb3e0/0x51de7f756a83dde2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f60a expref: 9 pid: 8068 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.136118:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ecafb3e0/0x51de7f756a83dde2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f60a expref: 9 pid: 8068 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788916987.136126:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a6e3f324380 00000100:00100000:3.0:1788916987.136190:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:3.0:1788916987.136200:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:2374:x1875815113474048:12345-192.168.202.40@tcp:4:lfs.0 00000100:00100000:3.0:1788916987.136717:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f324380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+11:2374:x1875815113474048:12345-192.168.202.40@tcp:4:lfs.0 Request processed in 515us (853us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788916987.136726:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00002000:00100000:3.0:1788916987.136733:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9a6e3f324380 x1875815113474048/t4294967302(0) o4->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:368/0 lens 504/448 e 0 to 0 dl 1788916998 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788916987.136741:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e3f324380 with x1875815113474048 ext(0->8) 00010000:00010000:3.0:1788916987.136747:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ecafb3e0/0x51de7f756a83dde2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f60a expref: 11 pid: 8068 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.136778:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ecafb3e0/0x51de7f756a83dde2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f60a expref: 11 pid: 8068 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788916987.136786:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a6e3f324380 00000100:00100000:0.0:1788916987.137060:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3641a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1875815140754048:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788916987.137086:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83de21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916987.140285:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916987.140387:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113474176 00000100:00100000:2.0:1788916987.140398:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113474176 00010000:00010000:2.0:1788916987.140453:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ecafb3e0/0x51de7f756a83dde2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f60a expref: 11 pid: 8068 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916987.140502:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:2.0:1788916987.140513:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3641a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+11:2373:x1875815113474176:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788916987.140536:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788916987.140569:0:5778:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788916987.140573:0:5778:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788916986 00002000:00010000:2.0:1788916987.140575:0:5778:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788916986 00002000:00010000:2.0:1788916987.140577:0:5778:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788916986 00010000:00010000:2.0:1788916987.140584:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ecafb3e0/0x51de7f756a83dde2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f60a expref: 11 pid: 8068 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.140599:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ecafb3e0/0x51de7f756a83dde2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f60a expref: 11 pid: 8068 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.140628:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecafb3e0/0x51de7f756a83dde2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f60a expref: 11 pid: 8068 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.140648:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788916987.140652:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788916987.140658:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83de21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.140669:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83de21 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.140716:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788916987.140788:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3641a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+10:2373:x1875815113474176:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 276us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916987.140796:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 50 00010000:00010000:0.0:1788916987.141397:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83de21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.141408:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83de21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.141434:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83de21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.141444:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83de21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.141452:0:6593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83de21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.141473:0:6593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788916987.141478:0:6593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83de21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.141487:0:6593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83de21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.141499:0:6593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83de21 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.141507:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e21d63c3/0x51de7f756a83de21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916987.141576:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3b1c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:2371:x1875815113473920:12345-192.168.202.40@tcp:1:lfs.0 Request processed in 11446us (11765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916987.141584:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:0.0:1788916987.144865:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916987.144962:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113474432 00000100:00100000:3.0:1788916987.144974:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113474432 00000100:00100000:3.0:1788916987.145038:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:3.0:1788916987.145049:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e08cfe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+38:10541:x1875815113474432:12345-192.168.202.40@tcp:35:lfs.0 00000004:00010000:3.0:1788916987.145117:0:5796:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83de13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f61f expref: 38 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788916987.145457:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788916987.145505:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788916987.145892:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1788916987.145947:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83de28 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.145964:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83ddcd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5fc expref: 42 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.145972:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83de28 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.146009:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83ddcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5fc expref: 42 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.146025:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83ddcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5fc expref: 42 pid: 8069 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916987.146048:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5796:1875815140754176:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788916987.146468:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3730e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788916987.149412:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916987.149495:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113474560 00000100:00100000:2.0:1788916987.149505:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113474560 00010000:00010000:2.0:1788916987.149546:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83ddcd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5fc expref: 43 pid: 8069 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916987.149599:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:2.0:1788916987.149609:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f327100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+43:2373:x1875815113474560:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788916987.149625:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916987.149632:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83ddcd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5fc expref: 43 pid: 8069 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.149645:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83ddcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5fc expref: 43 pid: 8069 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.149666:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86b00) 00010000:00010000:2.0:1788916987.149671:0:6606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83de28 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.149680:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83de28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.149688:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83de28 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.149713:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788916987.149773:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f327100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+43:2373:x1875815113474560:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 165us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916987.149781:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00010000:00010000:3.0:1788916987.150468:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83ddcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5fc expref: 42 pid: 8069 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916987.150491:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5796:1875815140754176:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788916987.150519:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83de28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.150534:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83de28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.150540:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83de28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788916987.150685:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788916987.150990:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1788916987.151124:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5796:1875815140754304:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788916987.152712:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916987.152792:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3730e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788916987.152841:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140754304 00000100:00100000:3.0:1788916987.152850:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140754304 00000100:00100000:3.0:1788916987.153101:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788916987.153112:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5796:x1875815140754304:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788916987.153294:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5796:x1875815140754304:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 185us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916987.153302:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788916987.153456:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788916987.153509:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5796:1875815140754304:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788916987.154434:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788916987.154515:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f326a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5796:1875815140754432:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788916987.154576:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916987.154637:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e02b9be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788916987.154677:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140754432 00000100:00100000:3.0:1788916987.154688:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140754432 00000100:00100000:3.0:1788916987.154757:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788916987.154766:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5796:x1875815140754432:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788916987.155128:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5796:x1875815140754432:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 362us (550us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788916987.155136:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788916987.155346:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f326a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5796:1875815140754432:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788916987.155400:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788916987.155437:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83de28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916987.155447:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83de28 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916987.155457:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83de28 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916987.155463:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18ee00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916987.155468:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83de28 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916987.155477:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83de28 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916987.155493:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86b00) 00010000:00010000:1.0:1788916987.155496:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788916987.155500:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83de28 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916987.155506:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83de28 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788916987.155695:0:5796:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788916987.155791:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788916987.155802:0:5796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 383187654855ns, next at 384187653181ns, rc = 0 00000001:00080000:1.0:1788916987.155808:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788916987.155834:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86b00) 00010000:00010000:1.0:1788916987.155837:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788916987.155844:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83de13 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f61f expref: 46 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916987.156452:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e08cfe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+45:10541:x1875815113474432:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 11403us (11596us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788916987.156462:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000020:00080000:1.0:1788916987.156467:0:5796:0:(tgt_main.c:816:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788916987.159127:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916987.159401:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113474688 00000100:00100000:0.0:1788916987.159411:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113474688 00000100:00100000:0.0:1788916987.159509:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 100 00000100:00100000:0.0:1788916987.159520:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+45:10541:x1875815113474688:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1788916987.159545:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916987.159596:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83de2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f626 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.159667:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83de2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f626 expref: 46 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.159682:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83de2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f626 expref: 46 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.159703:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:0.0:1788916987.159706:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788916987.159709:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3200, rc 0) 00000100:00100000:0.0:1788916987.159777:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+46:10541:x1875815113474688:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 259us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916987.159784:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 100 00000100:00100000:3.0:1788916987.162126:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916987.162248:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113474944 00000100:00100000:1.0:1788916987.162259:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113474944 00000100:00100000:1.0:1788916987.162323:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:1.0:1788916987.162335:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+46:10541:x1875815113474944:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1788916987.162601:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+47:10541:x1875815113474944:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 268us (480us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788916987.162609:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:1.0:1788916987.247723:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916987.247788:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113475072 00000100:00100000:3.0:1788916987.247800:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113475072 00000100:00100000:3.0:1788916987.248368:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 101 00000100:00100000:3.0:1788916987.248381:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+47:10551:x1875815113475072:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:3.0:1788916987.248460:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83de36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248476:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83de36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248489:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83de36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248504:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83de3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248512:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83de3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248518:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83de3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248637:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248660:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248667:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788916987.248710:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248723:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83de36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248729:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83de36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248736:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83de36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248743:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18fc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916987.248747:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83de36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248755:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83de36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248767:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:3.0:1788916987.248770:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916987.248775:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83de36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248782:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83de36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248802:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83de3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248809:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83de3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248815:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83de3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248820:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916987.248823:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83de3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248829:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83de3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248837:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e02ceed00) 00010000:00010000:3.0:1788916987.248839:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916987.248842:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83de3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248847:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83de3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248861:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.248879:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.249626:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.249641:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916987.249645:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.249652:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.249661:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:3.0:1788916987.249663:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916987.249666:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.249672:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916987.249770:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+47:10551:x1875815113475072:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 1388us (2055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916987.249780:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 101 00000100:00100000:1.0:1788916987.294646:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916987.294758:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113475328 00000100:00100000:2.0:1788916987.294770:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113475328 00000100:00100000:2.0:1788916987.294843:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 102 00000100:00100000:2.0:1788916987.294854:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+47:10556:x1875815113475328:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788916987.294877:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916987.294901:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83de4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f62d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.294983:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83de52 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.294999:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83de52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295011:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83de52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295026:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83de59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295034:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83de59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295041:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83de59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295503:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83de60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295514:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83de60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295522:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83de60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916987.295532:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788916987.295659:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83de52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295666:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83de52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295673:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83de52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295679:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916987.295684:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83de52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295691:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83de52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295704:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:2.0:1788916987.295707:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916987.295711:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83de52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295728:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83de52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295748:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83de59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295754:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83de59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295759:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83de59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295765:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916987.295768:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83de59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295773:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83de59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.295784:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e02f3c500) 00010000:00010000:2.0:1788916987.295786:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916987.295789:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83de59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.296400:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83de59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.296459:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83de4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f62d expref: 50 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.296477:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83de60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f62d expref: 49 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.296493:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:2.0:1788916987.296495:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788916987.296497:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031600, rc 0) 00000100:00100000:2.0:1788916987.296579:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+49:10556:x1875815113475328:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1727us (1943us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788916987.296588:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 102 00000100:00100000:0.0:1788916987.304973:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916987.305066:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113475456 00000100:00100000:2.0:1788916987.305077:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113475456 00000100:00100000:2.0:1788916987.305174:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 103 00000100:00100000:2.0:1788916987.305187:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3641a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+49:10556:x1875815113475456:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:2.0:1788916987.305278:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83de6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.305296:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83de6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.305307:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83de6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.305337:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83de6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.305344:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83de6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.305351:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83de6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.305357:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916987.305374:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83de6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.305382:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83de6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.305395:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:2.0:1788916987.305398:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788916987.305402:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83de6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.305408:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83de6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916987.305501:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3641a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+49:10556:x1875815113475456:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 317us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916987.305509:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 103 00000100:00100000:0.0:1788916987.308565:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916987.308627:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113475712 00000100:00100000:1.0:1788916987.308639:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113475712 00000100:00100000:1.0:1788916987.308697:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:1.0:1788916987.308722:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+49:10556:x1875815113475712:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1788916987.309013:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+50:10556:x1875815113475712:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 294us (519us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788916987.309022:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:1.0:1788916987.369901:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916987.370055:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113475968 00000100:00100000:0.0:1788916987.370066:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113475968 00000100:00100000:0.0:1788916987.370141:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 104 00000100:00100000:0.0:1788916987.370188:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+50:10566:x1875815113475968:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1788916987.370215:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916987.370219:0:8069:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788916987.370248:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83ddf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f611 expref: 50 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.370272:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:0.0:1788916987.370277:0:8069:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788916987.370305:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83de75 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f634 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.370426:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83de7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.370440:0:8069:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83de60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f62d expref: 50 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.370450:0:8069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83de7c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.370482:0:8069:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83de60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f62d expref: 50 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916987.370496:0:8069:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83de60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f62d expref: 50 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916987.370511:0:8069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3641aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140754560:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788916987.370623:0:8069:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788916987.375441:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916987.375868:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113476096 00000100:00100000:3.0:1788916987.375880:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113476096 00010000:00010000:3.0:1788916987.375925:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83de60 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f62d expref: 51 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916987.375970:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:3.0:1788916987.375981:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36419f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+51:2373:x1875815113476096:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788916987.375998:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916987.376005:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83de60 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f62d expref: 51 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.376039:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83de60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f62d expref: 51 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.376063:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:3.0:1788916987.376069:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83de7c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.376080:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83de7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.376088:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83de7c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.376107:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916987.376208:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36419f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+51:2373:x1875815113476096:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 228us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916987.376216:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 52 00010000:00010000:2.0:1788916987.376399:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83de60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f62d expref: 50 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916987.376421:0:8069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3641aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140754560:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788916987.376444:0:8069:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83de7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.376453:0:8069:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83de7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.376459:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83de7c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916987.376478:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788916987.376664:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83de75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f634 expref: 51 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.376676:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83de7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f634 expref: 50 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.376682:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:2.0:1788916987.376684:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788916987.376686:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2c00, rc 0) 00000100:00100000:2.0:1788916987.376709:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+50:10566:x1875815113475968:12345-192.168.202.40@tcp:101:bash.0 Request processed in 6526us (6821us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788916987.376714:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 104 00000100:00100000:1.0:1788916987.381448:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916987.381629:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113476352 00000100:00100000:3.0:1788916987.381638:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113476352 00000100:00100000:3.0:1788916987.381718:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 105 00000100:00100000:3.0:1788916987.381727:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+50:10566:x1875815113476352:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:3.0:1788916987.382003:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.382021:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.382033:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788916987.382090:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1788916987.382111:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a1a34b2e reply state 00000000e696a4fa transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916987.382120:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788916987.382246:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+53:10566:x1875815113476352:12345-192.168.202.40@tcp:36:bash.0 Request processed in 519us (805us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788916987.382261:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 105 00000020:00080000:3.0:1788916987.382266:0:5794:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788916987.391907:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.391928:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.391936:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.391942:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916987.391947:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.391955:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916987.392117:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1788916987.392208:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:3.0:1788916987.392211:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916987.392216:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.392232:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83de8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916987.392691:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113476480 00000100:00100000:2.0:1788916987.392703:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113476480 00000100:00100000:2.0:1788916987.392770:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 106 00000100:00100000:2.0:1788916987.392781:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+52:10566:x1875815113476480:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1788916987.392808:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916987.392830:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83de91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f63b expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.392989:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83de98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.393005:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83de7c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f634 expref: 53 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.393013:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83de98 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.393062:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83de7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f634 expref: 53 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.393075:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83de7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f634 expref: 53 pid: 8069 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916987.393097:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd31180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1875815140754688:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788916987.393281:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36fe6840 going to sleep for 11 seconds 00000100:00100000:1.0:1788916987.396744:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916987.397487:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd31180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1875815140754688:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788916987.397515:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83de98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916987.398706:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113476608 00000100:00100000:3.0:1788916987.398718:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113476608 00010000:00010000:3.0:1788916987.398762:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83de7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f634 expref: 54 pid: 8069 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916987.398803:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:3.0:1788916987.398814:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+54:2374:x1875815113476608:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788916987.398833:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916987.398840:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83de7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f634 expref: 54 pid: 8069 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.398851:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83de7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f634 expref: 54 pid: 8069 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.398894:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83de7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f634 expref: 54 pid: 8069 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.398910:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:3.0:1788916987.398916:0:6606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83de98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.398925:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83de98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.398932:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83de98 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.398963:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916987.399084:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f327b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+53:2374:x1875815113476608:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 270us (2348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916987.399091:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00010000:00010000:2.0:1788916987.400034:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83de98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.400044:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83de98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916987.400094:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788916987.400099:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788916987.400121:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83de98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.400190:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83de91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f63b expref: 53 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.400210:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83de98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f63b expref: 52 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.400976:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:2.0:1788916987.400979:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788916987.400982:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168e800, rc 0) 00000100:00100000:2.0:1788916987.401033:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+52:10566:x1875815113476480:12345-192.168.202.40@tcp:101:bash.0 Request processed in 8254us (8921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916987.401039:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 106 00000100:00100000:0.0:1788916987.405966:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916987.406120:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113476864 00000100:00100000:2.0:1788916987.406131:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113476864 00000100:00100000:2.0:1788916987.406444:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:2.0:1788916987.406456:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+52:10566:x1875815113476864:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:2.0:1788916987.406731:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+53:10566:x1875815113476864:12345-192.168.202.40@tcp:35:bash.0 Request processed in 276us (772us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788916987.406740:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:0.0:1788916987.474980:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916987.475058:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113476992 00000100:00100000:2.0:1788916987.475067:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113476992 00000100:00100000:2.0:1788916987.475135:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 107 00000100:00100000:2.0:1788916987.475180:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3641aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+53:10572:x1875815113476992:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788916987.475208:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916987.475238:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83de9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f642 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.475310:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dea6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.475326:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.475352:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916987.475420:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1788916987.475424:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788916987.475448:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.475475:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83de9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f642 expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.475508:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dea6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f642 expref: 54 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.475517:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:2.0:1788916987.475520:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788916987.475523:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f200, rc 0) 00000100:00100000:2.0:1788916987.475614:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3641aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+54:10572:x1875815113476992:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 469us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916987.475621:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 107 00000100:00100000:0.0:1788916987.478797:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916987.479412:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113477120 00000100:00100000:2.0:1788916987.479424:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113477120 00000100:00100000:2.0:1788916987.479508:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 108 00000100:00100000:2.0:1788916987.479519:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+54:10572:x1875815113477120:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788916987.479544:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916987.479579:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83dead lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f649 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.479680:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83deb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.479698:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83deb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.479710:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83deb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.479725:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83debb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.479732:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83debb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.479739:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83debb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.480637:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83dec2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.480650:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83dec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.480659:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83dec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916987.480701:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788916987.480706:0:8069:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788916987.480726:0:8069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83dec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.480753:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83dec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.480763:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83deb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.480770:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83deb4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.480777:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83deb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.480783:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168e200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916987.480787:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83deb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.480795:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83deb4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.480808:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:2.0:1788916987.480811:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916987.480816:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83deb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.480822:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83deb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.480837:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83debb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.480844:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83debb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.480860:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83debb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.481622:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916987.481627:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83debb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.481634:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83debb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.481645:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e02f3c500) 00010000:00010000:2.0:1788916987.481647:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916987.481650:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83debb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.481656:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83debb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.481699:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83dead lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f649 expref: 56 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.481714:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83dec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f649 expref: 55 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.481722:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:2.0:1788916987.481724:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788916987.481727:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168fc00, rc 0) 00000100:00100000:2.0:1788916987.481794:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:10572:x1875815113477120:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 2277us (3007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916987.481814:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 108 00000100:00100000:0.0:1788916987.489313:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916987.489357:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916987.489358:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113477376 00000100:00100000:2.0:1788916987.489368:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113477376 00000100:00100000:2.0:1788916987.489433:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 109 00000100:00100000:2.0:1788916987.489443:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3730b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:10572:x1875815113477376:12345-192.168.202.40@tcp:101:lfs.0 00000100:00100000:3.0:1788916987.489445:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113477504 00000100:00100000:3.0:1788916987.489449:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113477504 00010000:00010000:2.0:1788916987.489466:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788916987.489480:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:3.0:1788916987.489486:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3730bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+56:2371:x1875815113477504:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788916987.489488:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83dec9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f650 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.489617:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916987.489617:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83ded0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.489696:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83dec2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f649 expref: 57 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.489700:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83de98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f63b expref: 57 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.489710:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83ded0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.489719:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:3.0:1788916987.489723:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83ded0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.489729:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83ded0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.489735:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788916987.489752:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83de98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f63b expref: 56 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.489763:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83de98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f63b expref: 56 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916987.489777:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd31180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1875815140754816:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788916987.489790:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3730bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+56:2371:x1875815113477504:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 304us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916987.489797:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:2.0:1788916987.489843:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36fe6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788916987.493364:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd31180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1875815140754816:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788916987.493407:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83ded0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916987.493842:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916987.494361:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113477632 00000100:00100000:3.0:1788916987.494370:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113477632 00010000:00010000:3.0:1788916987.494411:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83de98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f63b expref: 56 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916987.494517:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:3.0:1788916987.494527:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e408e2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+56:2373:x1875815113477632:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788916987.494562:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916987.494570:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83de98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f63b expref: 56 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.494583:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83de98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f63b expref: 56 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.494605:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83de98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f63b expref: 56 pid: 5793 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.494623:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:3.0:1788916987.494628:0:6606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83ded0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.494638:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83ded0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.494646:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83ded0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916987.494676:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916987.494732:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e408e2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:2373:x1875815113477632:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 206us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916987.494741:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00010000:00010000:2.0:1788916987.494826:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83ded0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.494834:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83ded0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916987.494855:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788916987.495017:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83dec9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f650 expref: 56 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.495032:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83ded0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f650 expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916987.495039:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:2.0:1788916987.495042:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788916987.495044:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f600, rc 0) 00000100:00100000:2.0:1788916987.495070:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3730b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:10572:x1875815113477376:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 5629us (5863us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788916987.495077:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 109 00000100:00100000:0.0:1788916987.507522:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916987.507630:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113477888 00000100:00100000:1.0:1788916987.507639:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113477888 00000100:00100000:1.0:1788916987.507711:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:1.0:1788916987.507723:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37308380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:10572:x1875815113477888:12345-192.168.202.40@tcp:103:lfs.0 00010000:00010000:1.0:1788916987.507741:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916987.507768:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83de2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f626 expref: 55 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916987.507787:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:1.0:1788916987.507793:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916987.507849:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37308380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+54:10572:x1875815113477888:12345-192.168.202.40@tcp:103:lfs.0 Request processed in 128us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916987.507857:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:0.0:1788916987.515763:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916987.516300:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113478016 00000100:00100000:1.0:1788916987.516310:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113478016 00000100:00100000:1.0:1788916987.516374:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 110 00000100:00100000:1.0:1788916987.516385:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3730bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+54:10572:x1875815113478016:12345-192.168.202.40@tcp:58:lfs.0 00010000:00010000:1.0:1788916987.517355:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83dede lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916987.517388:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83dede lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916987.517402:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83dede lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788916987.517641:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788916987.517740:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3730bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+54:10572:x1875815113478016:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 1355us (1984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916987.517750:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 110 00000100:00100000:0.0:1788916987.523240:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916987.523322:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113478144 00000100:00100000:1.0:1788916987.523333:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113478144 00000100:00100000:1.0:1788916987.523403:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 111 00000100:00100000:1.0:1788916987.523413:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+54:10572:x1875815113478144:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1788916987.523436:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916987.523456:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa000/0x51de7f756a83dee5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f657 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916987.523517:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83dede lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916987.523529:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa000/0x51de7f756a83dee5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f657 expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916987.523549:0:5794:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83dede lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916987.523575:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa000/0x51de7f756a83dee5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f657 expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916987.523605:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:1.0:1788916987.523608:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788916987.523612:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa000/0x51de7f756a83dee5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f657 expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916987.523620:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeaa000, rc 0) 00000100:00100000:1.0:1788916987.523682:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:10572:x1875815113478144:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 271us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916987.523689:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 111 00010000:00010000:3.0:1788916987.681617:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788916987.993451:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:2.0:1788916987.993470:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:2.0:1788916987.993635:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:2.0:1788916987.993737:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1788916987.993746:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000040:00080000:1.0:1788916988.323332:0:11537:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788916988.323342:0:11537:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788916988.323392:0:11537:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788916988.323399:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788916988.324700:0:11537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f326300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1875815140754944:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788916988.324801:0:11537:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e02b9bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916988.334756:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916988.336717:0:11537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f326300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1875815140754944:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788916988.340583:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113478272 00000100:00100000:2.0:1788916988.340599:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113478272 00000100:00100000:2.0:1788916988.340746:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 112 00000100:00100000:2.0:1788916988.340761:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:10573:x1875815113478272:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788916988.340800:0:8069:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788916988.340914:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:10573:x1875815113478272:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 159us (6169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916988.340922:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 112 00000100:00080000:0.0:1788916988.341813:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788916988.344366:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916988.344490:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113478400 00000100:00100000:1.0:1788916988.344500:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113478400 00000100:00100000:1.0:1788916988.344570:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 113 00000100:00100000:1.0:1788916988.344581:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:10573:x1875815113478400:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788916988.344660:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83deec lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.344678:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83deec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.344709:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83deec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346134:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83def3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346180:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83def3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346191:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83def3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346223:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83defa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346232:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83defa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346239:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83defa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788916988.346285:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788916988.346290:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788916988.346306:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83defa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346318:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83deec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346325:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83deec lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346347:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83deec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346353:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaaa00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916988.346358:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83deec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346366:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83deec lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346379:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:1.0:1788916988.346383:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788916988.346387:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83deec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346394:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83deec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346409:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83def3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346416:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83def3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346422:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83def3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346428:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916988.346431:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83def3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346448:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83def3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346457:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9a6e1959ef00) 00010000:00010000:1.0:1788916988.346460:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788916988.346463:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83def3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346468:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83def3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346483:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83defa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346489:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83defa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346495:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83defa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346500:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaae00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916988.346503:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83defa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346509:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83defa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346517:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:1.0:1788916988.346519:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788916988.346521:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83defa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.346537:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83defa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916988.346631:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:10573:x1875815113478400:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 Request processed in 2049us (2270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916988.346642:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 113 00000100:00100000:0.0:1788916988.351964:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916988.352035:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113478656 00000100:00100000:2.0:1788916988.352044:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113478656 00000100:00100000:2.0:1788916988.352105:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 114 00000100:00100000:2.0:1788916988.352115:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0821dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:10573:x1875815113478656:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788916988.352170:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916988.352194:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83df01 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f65e expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.352287:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83df08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.352298:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83df08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.352317:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83df08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916988.352326:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788916988.352409:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83df08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.352414:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83df08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.352433:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83df08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.352437:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168ee00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916988.352440:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83df08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.352445:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83df08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.352455:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:2.0:1788916988.352457:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788916988.352460:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83df08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.352464:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83df08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.352499:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83df01 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f65e expref: 57 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.352509:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:2.0:1788916988.352511:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788916988.352514:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83df01 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f65e expref: 57 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.352523:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168e200, rc 0) 00000100:00100000:2.0:1788916988.352587:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0821dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+56:10573:x1875815113478656:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 472us (630us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788916988.352600:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 114 00000100:00100000:3.0:1788916988.365126:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916988.365316:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113478784 00000100:00100000:1.0:1788916988.365326:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113478784 00000100:00100000:1.0:1788916988.365389:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:1.0:1788916988.365399:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+56:10573:x1875815113478784:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788916988.365438:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788916988.365563:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+56:10573:x1875815113478784:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 164us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916988.365572:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:0.0:1788916988.369680:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916988.369785:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113479040 00000100:00100000:2.0:1788916988.369796:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113479040 00000100:00100000:2.0:1788916988.369857:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:2.0:1788916988.369869:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+56:10573:x1875815113479040:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788916988.369893:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916988.369896:0:8069:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788916988.369927:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dea6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f642 expref: 56 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.369951:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:2.0:1788916988.369956:0:8069:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788916988.369979:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83df16 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f665 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788916988.370588:0:8069:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788916988.370798:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83df1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.370813:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83df1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.370825:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83df1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.370881:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83df16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f665 expref: 58 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.370919:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83df1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f665 expref: 57 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.370928:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6e02f3c500) 00010000:00010000:2.0:1788916988.370932:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788916988.370935:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168ee00, rc 0) 00000100:00100000:2.0:1788916988.371298:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+57:10573:x1875815113479040:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 1429us (1626us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788916988.371308:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:0.0:1788916988.386216:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916988.386353:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113479296 00000100:00100000:1.0:1788916988.386363:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113479296 00000100:00100000:1.0:1788916988.386420:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 117 00000100:00100000:1.0:1788916988.386430:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+57:10573:x1875815113479296:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788916988.386500:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916988.386527:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83df1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f665 expref: 57 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386555:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6e02f3c500) 00010000:00010000:1.0:1788916988.386570:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788916988.386596:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83df2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386630:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83df2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386642:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83df2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386659:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83df32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe4151fd8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386666:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83df32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe4151fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386672:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83df32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe4151fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386756:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83df2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386764:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83df2b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386771:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83df2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386776:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaae00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916988.386780:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83df2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386787:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83df2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386795:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:1.0:1788916988.386803:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788916988.386808:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83df2b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386813:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83df2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386822:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83df32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe4151fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386828:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83df32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe4151fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386833:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83df32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe4151fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386839:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916988.386842:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83df32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe4151fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386848:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83df32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe4151fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386854:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe4151fd8 (ffff9a6e1959ef00) 00010000:00010000:1.0:1788916988.386857:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788916988.386859:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83df32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe4151fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.386865:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83df32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe4151fd8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916988.388100:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+56:10573:x1875815113479296:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 1664us (1887us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788916988.388124:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 117 00000100:00100000:3.0:1788916988.390230:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916988.391119:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113479424 00000100:00100000:1.0:1788916988.391130:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113479424 00000100:00100000:1.0:1788916988.391212:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:1.0:1788916988.391222:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+56:10573:x1875815113479424:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788916988.391244:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916988.391266:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83df39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f66c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.391315:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83df40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.391332:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83df40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.391343:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83df40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.391443:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83df39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f66c expref: 58 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.391461:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83df40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f66c expref: 57 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.391469:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6e1959ec00) 00010000:00010000:1.0:1788916988.391472:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788916988.391476:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeaba00, rc 0) 00000100:00100000:1.0:1788916988.391531:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+57:10573:x1875815113479424:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 310us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916988.391569:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:0.0:1788916988.395073:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916988.395427:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113479680 00000100:00100000:2.0:1788916988.395441:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113479680 00000100:00100000:2.0:1788916988.395592:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 119 00000100:00100000:2.0:1788916988.395605:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+57:10573:x1875815113479680:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788916988.395710:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83df47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.395730:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83df47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.395743:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83df47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788916988.396188:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788916988.396199:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 384428052339ns, next at 385428049126ns, rc = 0 00000004:00010000:2.0:1788916988.396284:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e29b7f77 reply state 00000000f13f572c transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83df47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916988.396316:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788916988.396444:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+59:10573:x1875815113479680:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 840us (1381us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788916988.396454:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 119 00010000:00010000:2.0:1788916988.401240:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83df47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.401262:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83df47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.401270:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83df47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.401277:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168e200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916988.401283:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83df47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.401291:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83df47 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.401312:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6e1959ec00) 00010000:00010000:2.0:1788916988.401315:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788916988.401321:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83df47 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.401328:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83df47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916988.415846:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916988.416068:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113479808 00000100:00100000:1.0:1788916988.416080:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113479808 00000100:00100000:1.0:1788916988.416167:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00100000:1.0:1788916988.416179:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+58:10573:x1875815113479808:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788916988.416209:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916988.416230:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83df4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f673 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.416300:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83df4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f673 expref: 59 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.416316:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83df4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f673 expref: 59 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.416337:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6e1959ec00) 00010000:00010000:1.0:1788916988.416340:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788916988.416344:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeaaa00, rc 0) 00000100:00100000:1.0:1788916988.416406:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+59:10573:x1875815113479808:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 228us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916988.416414:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00100000:0.0:1788916988.424326:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916988.424404:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113479936 00000100:00100000:3.0:1788916988.424414:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113479936 00000100:00100000:3.0:1788916988.424516:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:3.0:1788916988.424528:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2374:x1875815113479936:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788916988.424865:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:2374:x1875815113479936:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 339us (550us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788916988.424873:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00080000:0.0:1788916988.424945:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788916988.430293:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916988.430421:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113480192 00000100:00100000:1.0:1788916988.430430:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113480192 00000100:00100000:1.0:1788916988.430485:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:1.0:1788916988.430501:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+59:10573:x1875815113480192:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788916988.430732:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+60:10573:x1875815113480192:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 238us (448us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788916988.430753:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:1.0:1788916988.436877:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916988.436979:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113480448 00000100:00100000:3.0:1788916988.436991:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113480448 00000100:00100000:3.0:1788916988.437051:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 121 00000100:00100000:3.0:1788916988.437063:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+60:10573:x1875815113480448:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788916988.437216:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+60:10573:x1875815113480448:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 156us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916988.437224:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 121 00000100:00100000:0.0:1788916988.440286:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916988.440432:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113480576 00000100:00100000:1.0:1788916988.440442:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113480576 00000100:00100000:1.0:1788916988.440559:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:1.0:1788916988.440570:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+60:10573:x1875815113480576:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788916988.440592:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916988.440614:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83df55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f67a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.440693:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83df5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.440708:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83df5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.440721:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83df5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788916988.440759:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788916988.440778:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83df5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.440818:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83df55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f67a expref: 62 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.440838:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83df5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f67a expref: 61 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.440865:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6e1959ec00) 00010000:00010000:1.0:1788916988.440869:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788916988.440872:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeab400, rc 0) 00000100:00100000:1.0:1788916988.440934:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+61:10573:x1875815113480576:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 366us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916988.440942:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:0.0:1788916988.444055:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916988.444183:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113480704 00000100:00100000:3.0:1788916988.444194:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113480704 00000100:00100000:3.0:1788916988.444248:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:3.0:1788916988.444259:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:2374:x1875815113480704:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788916988.444279:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916988.444301:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df63 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f681 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788916988.444341:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0b4fb, blocks: 0x1 00010000:00010000:3.0:1788916988.444363:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1788916988.444369:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788916988.444384:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f681 expref: 10 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.444427:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f681 expref: 10 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.444442:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e800, rc 0) 00000100:00100000:3.0:1788916988.444500:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+10:2374:x1875815113480704:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 243us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916988.444508:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:0.0:1788916988.452255:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916988.452322:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113480960 00000100:00100000:3.0:1788916988.452334:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113480960 00000100:00100000:3.0:1788916988.452390:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00100000:3.0:1788916988.452400:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+61:10573:x1875815113480960:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788916988.452517:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+61:10573:x1875815113480960:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 119us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916988.452525:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00100000:0.0:1788916988.456934:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916988.457137:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113481088 00000100:00100000:3.0:1788916988.457184:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113481088 00000100:00100000:3.0:1788916988.457245:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:3.0:1788916988.457256:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+10:10573:x1875815113481088:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788916988.457275:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916988.457296:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f23f8dc2/0x51de7f756a83df6a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f688 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.457339:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df63 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f681 expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.457369:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788916988.457375:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788916988.457381:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f23f8dc2/0x51de7f756a83df6a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f688 expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.457416:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f681 expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.457428:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f681 expref: 11 pid: 6590 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916988.457442:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6592:1875815140755072:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788916988.457530:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cd9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788916988.467382:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6592:1875815140755072:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788916988.467429:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f23f8dc2/0x51de7f756a83df6a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f688 expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.467450:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f400, rc 0) 00000100:00100000:3.0:1788916988.467823:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+11:10573:x1875815113481088:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 10567us (10897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916988.467833:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:0.0:1788916988.468330:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916988.468461:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113481216 00000100:00100000:3.0:1788916988.468469:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113481216 00010000:00010000:3.0:1788916988.468631:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f681 expref: 11 pid: 6590 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916988.468725:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:3.0:1788916988.468736:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c991f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+11:2373:x1875815113481216:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788916988.468751:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916988.468774:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f681 expref: 11 pid: 6590 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.468787:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f681 expref: 11 pid: 6590 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.468823:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df63 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f681 expref: 11 pid: 6590 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.468839:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788916988.468845:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788916988.468853:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f23f8dc2/0x51de7f756a83df6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f688 expref: 10 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.468864:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f23f8dc2/0x51de7f756a83df6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f688 expref: 10 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.468900:0:5779:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f23f8dc2/0x51de7f756a83df6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f688 expref: 10 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916988.468914:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5779:1875815140755200:192.168.202.40@tcp:105: 00000100:00100000:3.0:1788916988.469139:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cd9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788916988.480413:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916988.480619:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5779:1875815140755200:192.168.202.40@tcp:105: 00010000:00010000:3.0:1788916988.480649:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916988.480710:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c991f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+10:2373:x1875815113481216:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 11976us (12380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916988.480723:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:1.0:1788916988.481405:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113481344 00000100:00100000:1.0:1788916988.481413:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113481344 00002000:00100000:1.0:1788916988.481467:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9a6e2c991180 x1875815113481344/t0(0) o4->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:369/0 lens 504/0 e 0 to 0 dl 1788916999 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788916988.481479:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e2c991180 with x1875815113481344 ext(0->12) 00002000:00010000:1.0:1788916988.481485:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6e2c991180 00000100:00100000:1.0:1788916988.481513:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:1.0:1788916988.481522:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c991180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+10:2374:x1875815113481344:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788916988.482449:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c991180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+12:2374:x1875815113481344:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 Request processed in 923us (2048us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788916988.482458:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00002000:00100000:1.0:1788916988.482466:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9a6e2c991180 x1875815113481344/t4294967308(0) o4->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:369/0 lens 504/448 e 0 to 0 dl 1788916999 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788916988.482475:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e2c991180 with x1875815113481344 ext(0->12) 00002000:00010000:1.0:1788916988.482479:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6e2c991180 00000100:00100000:0.0:1788916988.484775:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916988.484935:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113481472 00000100:00100000:2.0:1788916988.484945:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113481472 00000100:00100000:2.0:1788916988.485066:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:2.0:1788916988.485077:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+61:10573:x1875815113481472:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788916988.530615:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967377 is committed 00000001:00080000:3.0:1788916988.530648:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788916988.530663:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788916988.530686:0:5814:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6e02b9b840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788916988.530691:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e09e0a100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e02b9b000 00000020:00080000:3.0:1788916988.530695:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e09e0af00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e3c5f3800 00000004:00080000:3.0:1788916988.530712:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788916988.530749:0:5814:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6e36fe6300 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788916988.530751:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e3a245000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e36fe6240 00000020:00080000:3.0:1788916988.530754:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e3a245e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e03e2e000 00000004:00080000:3.0:1788916988.530782:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788916988.530802:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788916988.530986:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788916988.531111:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140755328:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788916988.531213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916988.531250:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788916988.531256:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140755456:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788916988.531277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916988.531311:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140755328 00000100:00100000:3.0:1788916988.531331:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140755328 00000100:00100000:3.0:1788916988.531384:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140755456 00000100:00100000:3.0:1788916988.531388:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140755456 00000100:00100000:3.0:1788916988.531406:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788916988.531414:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1875815140755328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788916988.531440:0:6593:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1788916988.531466:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.531489:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004c92d7a2/0x51de7f756a83dd33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5e7 expref: 11 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.531498:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788916988.531503:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788916988.531507:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df71 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.531534:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004c92d7a2/0x51de7f756a83dd33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5e7 expref: 11 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.531559:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004c92d7a2/0x51de7f756a83dd33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5e7 expref: 11 pid: 8068 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916988.531572:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6593:1875815140755584:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788916988.531628:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cd9f00 going to sleep for 11 seconds 00000100:00080000:3.0:1788916988.531639:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788916988.531653:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788916988.531667:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1875815140755456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788916988.531790:0:8068:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788916988.531794:0:8068:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788916987 00002000:00010000:3.0:1788916988.531796:0:8068:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788916988.531798:0:8068:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788916987 -> 1788916987 00002000:00010000:3.0:1788916988.531800:0:8068:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788916988.531836:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3306:x1875815140755456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (559us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788916988.531842:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1788916988.531970:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6e3fcbbb80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1788916988.531977:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140755456:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788916988.533228:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140755712:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788916988.533272:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916988.533485:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+15:10573:x1875815113481472:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 Request processed in 48407us (48714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916988.533495:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:0.0:1788916988.536285:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916988.536425:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6593:1875815140755584:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788916988.536458:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916988.536553:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113481600 00000100:00100000:1.0:1788916988.536561:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113481600 00010000:00010000:1.0:1788916988.536611:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004c92d7a2/0x51de7f756a83dd33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5e7 expref: 12 pid: 8068 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916988.536653:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:1.0:1788916988.536662:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+12:2374:x1875815113481600:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788916988.536677:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916988.536683:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004c92d7a2/0x51de7f756a83dd33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5e7 expref: 12 pid: 8068 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.536694:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004c92d7a2/0x51de7f756a83dd33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5e7 expref: 12 pid: 8068 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.536721:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c92d7a2/0x51de7f756a83dd33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5e7 expref: 12 pid: 8068 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.536738:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788916988.536742:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788916988.536747:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.536758:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df71 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.536790:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916988.536845:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+11:2374:x1875815113481600:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 183us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916988.537590:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:2.0:1788916988.537791:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140755712 00000100:00100000:2.0:1788916988.537799:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140755712 00000100:00100000:2.0:1788916988.537838:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788916988.537847:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3641a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140755712:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788916988.537889:0:8068:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1788916988.537929:0:8068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa0b4fa, atime: 0x6aa0b4fa, ctime: 0x6aa0b4fa, blocks: 0xb 00010000:00010000:2.0:1788916988.537937:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d5d5114/0x51de7f756a83df78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.537951:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1788916988.537956:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788916988.537962:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d5d5114/0x51de7f756a83df78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.537975:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d5d5114/0x51de7f756a83df78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.537986:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d5d5114/0x51de7f756a83df78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.537995:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d5d5114/0x51de7f756a83df78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.538021:0:8068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788916988.538678:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3641a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875815140755712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 830us (5403us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788916988.538693:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1788916988.538793:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.538804:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.538825:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.538833:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.538857:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788916988.539279:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3306:x1875815140755328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7865us (8066us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788916988.539288:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788916988.539747:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788916988.539754:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:3.0:1788916988.539780:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6e28d61f80, transno 4294967301 00000004:00080000:3.0:1788916988.539799:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:3.0:1788916988.539821:0:3304:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9a6e3f324a80 x1875815140755712/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788917004 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788916988.539833:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6e3f324a80/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788916988.539839:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140755712:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788916988.539899:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6e3fcb9c00/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788916988.539905:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140755328:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788916988.540016:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788916988.540025:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d5d5114/0x51de7f756a83df78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.540034:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168e200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788916988.540038:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d5d5114/0x51de7f756a83df78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.540048:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d5d5114/0x51de7f756a83df78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.540068:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d5d5114/0x51de7f756a83df78 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.540077:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d5d5114/0x51de7f756a83df78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.540098:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788916988.540102:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.540108:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e800 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788916988.540110:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.540128:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.540170:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.540178:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d707dcf/0x51de7f756a83df71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.540192:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916988.540193:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788916988.540195:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916988.540351:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916988.541600:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916988.541668:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113481728 00000100:00100000:3.0:1788916988.541677:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113481728 00000100:00100000:3.0:1788916988.541735:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:3.0:1788916988.541745:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+11:2373:x1875815113481728:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788916988.562939:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1788916988.562955:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1788916988.563131:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2373:x1875815113481728:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 Request processed in 21383us (21530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916988.563168:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:3.0:1788916988.566072:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916988.566472:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113481984 00000100:00100000:1.0:1788916988.566482:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113481984 00000100:00100000:1.0:1788916988.566551:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:1.0:1788916988.566561:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+15:10573:x1875815113481984:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788916988.566620:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916988.566651:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83df5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f67a expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.566670:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6e1959ec00) 00010000:00010000:1.0:1788916988.566675:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788916988.566706:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83df7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.566738:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83df7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.566749:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83df7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788916988.567390:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d260ac84 reply state 00000000ececbbc8 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83df7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916988.567401:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788916988.567537:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:10573:x1875815113481984:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 976us (1474us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788916988.567554:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:3.0:1788916988.569687:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916988.569760:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113482112 00000100:00100000:0.0:1788916988.569770:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113482112 00000100:00100000:0.0:1788916988.569824:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:0.0:1788916988.569834:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2372:x1875815113482112:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788916988.570312:0:6593:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788916988.570316:0:6593:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788916987 -> 1788916986 00002000:00010000:0.0:1788916988.570319:0:6593:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788916986 00002000:00010000:0.0:1788916988.570321:0:6593:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788916987 -> 1788916986 00002000:00010000:0.0:1788916988.570324:0:6593:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788916988.570382:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2372:x1875815113482112:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 549us (703us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788916988.570407:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:1.0:1788916988.572556:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916988.572636:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113482368 00000100:00100000:3.0:1788916988.572645:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113482368 00000100:00100000:3.0:1788916988.572698:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 126 00000100:00100000:3.0:1788916988.572709:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:10573:x1875815113482368:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788916988.572774:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83df86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.572793:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83df40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f66c expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.572803:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83df86 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.572839:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83df40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f66c expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916988.572852:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83df40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f66c expref: 16 pid: 5793 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916988.572896:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e03856d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1875815140755840:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788916988.572981:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cd9e40 going to sleep for 11 seconds 00010000:00010000:2.0:1788916988.575568:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83df7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.575586:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83df7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.575594:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83df7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.575602:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaa600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916988.575606:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83df7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.575614:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83df7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.575632:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6e1959ec00) 00010000:00010000:2.0:1788916988.575635:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916988.575640:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83df7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.575659:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83df7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916988.575889:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916988.576515:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e03856d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1875815140755840:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788916988.576557:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83df86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916988.576629:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113482496 00000100:00100000:2.0:1788916988.576636:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113482496 00010000:00010000:2.0:1788916988.576673:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83df40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f66c expref: 16 pid: 5793 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916988.576749:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:2.0:1788916988.576760:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f327480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:2373:x1875815113482496:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788916988.576775:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916988.576782:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83df40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f66c expref: 16 pid: 5793 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.576793:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83df40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f66c expref: 16 pid: 5793 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.576812:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaba00/0x51de7f756a83df40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f66c expref: 16 pid: 5793 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.576825:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6e1959ec00) 00010000:00010000:2.0:1788916988.576830:0:6606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83df86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.576839:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83df86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.576847:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83df86 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.576903:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788916988.577008:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83df86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.577016:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83df86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.577047:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83df86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.577053:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83df86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.577059:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83df86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.577064:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18fc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916988.577067:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83df86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.577074:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83df86 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.577084:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6e1959ec00) 00010000:00010000:1.0:1788916988.577093:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788916988.577097:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83df86 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.577103:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83df86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916988.577197:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f327480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+15:2373:x1875815113482496:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 438us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916988.577204:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:1.0:1788916988.577441:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:10573:x1875815113482368:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 Request processed in 4733us (4900us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788916988.577451:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 126 00000100:00100000:0.0:1788916988.583014:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916988.583086:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113482624 00000100:00100000:2.0:1788916988.583095:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113482624 00000100:00100000:2.0:1788916988.583227:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:2.0:1788916988.583236:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113482624:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788916988.583274:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f8db0532/0x51de7f756a83df8d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.583291:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f23f8dc2/0x51de7f756a83df6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f688 expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.583297:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788916988.583309:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788916988.583312:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8db0532/0x51de7f756a83df8d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.583340:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f23f8dc2/0x51de7f756a83df6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f688 expref: 7 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.583350:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f23f8dc2/0x51de7f756a83df6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f688 expref: 7 pid: 6592 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916988.583361:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8068:1875815140755968:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788916988.583434:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e096e3180 going to sleep for 11 seconds 00000100:00100000:1.0:1788916988.586061:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916988.586090:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113482752 00000100:00100000:1.0:1788916988.586096:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113482752 00010000:00010000:1.0:1788916988.586126:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f23f8dc2/0x51de7f756a83df6a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f688 expref: 8 pid: 6592 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916988.586169:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:1.0:1788916988.586176:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f326680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2373:x1875815113482752:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788916988.586189:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916988.586209:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f23f8dc2/0x51de7f756a83df6a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f688 expref: 8 pid: 6592 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.586220:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f23f8dc2/0x51de7f756a83df6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f688 expref: 8 pid: 6592 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.586241:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788916988.586246:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788916988.586250:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8db0532/0x51de7f756a83df8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.586269:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8db0532/0x51de7f756a83df8d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.586285:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916988.586561:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f326680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2373:x1875815113482752:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 383us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916988.586570:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00010000:00010000:2.0:1788916988.588036:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f23f8dc2/0x51de7f756a83df6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f688 expref: 7 pid: 6592 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916988.588059:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd31180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8068:1875815140755968:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788916988.588083:0:8068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f8db0532/0x51de7f756a83df8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.588096:0:8068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f8db0532/0x51de7f756a83df8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.588103:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8db0532/0x51de7f756a83df8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.588135:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f8db0532/0x51de7f756a83df8d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.588228:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8db0532/0x51de7f756a83df8d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.588238:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8db0532/0x51de7f756a83df8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.588245:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788916988.588249:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8db0532/0x51de7f756a83df8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.588276:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8db0532/0x51de7f756a83df8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.588293:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8db0532/0x51de7f756a83df8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.588301:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8db0532/0x51de7f756a83df8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916988.588432:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2374:x1875815113482624:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 Request processed in 5197us (5425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916988.588444:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:3.0:1788916988.594921:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916988.595058:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113483008 00000100:00100000:2.0:1788916988.595079:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113483008 00000100:00100000:0.0:1788916988.595203:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 127 00000100:00100000:0.0:1788916988.595215:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:10573:x1875815113483008:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788916988.595316:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83df94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.595336:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83df94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.595348:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83df94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.595583:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83df9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.595595:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83df4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f673 expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.595603:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83df9b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.595640:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83df4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f673 expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.595655:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83df4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f673 expref: 15 pid: 5793 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916988.595670:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1875815140756096:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788916988.595769:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6480 going to sleep for 11 seconds 00000100:00100000:3.0:1788916988.604402:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916988.604595:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113483136 00000100:00100000:1.0:1788916988.604607:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113483136 00010000:00010000:1.0:1788916988.604649:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83df4e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f673 expref: 16 pid: 5793 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916988.604694:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:1.0:1788916988.604705:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03854700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:2373:x1875815113483136:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788916988.604723:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916988.604731:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83df4e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f673 expref: 16 pid: 5793 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.604747:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83df4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f673 expref: 16 pid: 5793 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.604770:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6e1959ec00) 00010000:00010000:1.0:1788916988.604776:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83df9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.604786:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83df9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.604811:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83df9b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.604831:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916988.604904:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03854700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:2373:x1875815113483136:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 200us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916988.604912:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00010000:00010000:0.0:1788916988.606688:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83df4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f673 expref: 15 pid: 5793 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916988.606712:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1875815140756096:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788916988.606737:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83df9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.606748:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83df9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.606754:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83df9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788916988.607022:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788916988.607349:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788916988.607398:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788916988.607486:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5792:1875815140756224:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788916988.607564:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916988.607600:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788916988.608125:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140756224 00000100:00100000:2.0:1788916988.608142:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140756224 00000100:00100000:2.0:1788916988.608225:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788916988.608236:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5792:x1875815140756224:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788916988.608344:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5792:x1875815140756224:12345-0@lo:1000:mdt00_000.0 Request processed in 110us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916988.608351:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788916988.608418:0:5792:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788916988.608425:0:5792:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1788916988.608447:0:5792:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6e3fcbbb80, transno 4294967309 00000004:00080000:0.0:1788916988.608466:0:5792:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6e3fcb9c00, transno 4294967310 00000100:00100000:0.0:1788916988.608473:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5792:1875815140756224:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788916988.609099:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788916988.609208:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5792:1875815140756352:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788916988.609250:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916988.609287:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6480 going to sleep for 11 seconds 00000100:00100000:2.0:1788916988.609300:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140756352 00000100:00100000:2.0:1788916988.609306:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140756352 00000100:00100000:2.0:1788916988.609343:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788916988.609351:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5792:x1875815140756352:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788916988.609534:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5792:x1875815140756352:12345-0@lo:1000:mdt00_000.0 Request processed in 183us (283us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788916988.609552:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788916988.609614:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5792:1875815140756352:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788916988.609650:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83df9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.609659:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83df9b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.609667:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83df9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.609672:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916988.609677:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83df9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.609685:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83df9b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.609702:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6e1959ec00) 00010000:00010000:0.0:1788916988.609705:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788916988.609711:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83df9b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.609716:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83df9b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.609748:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83dede lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.609755:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83dede lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.609761:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83dede lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.609773:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeabe00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916988.609777:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83dede lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.609783:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83dede lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.609793:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:0.0:1788916988.609795:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788916988.609801:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa000/0x51de7f756a83dee5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f657 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.609812:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa000/0x51de7f756a83dee5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f657 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.609821:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa000/0x51de7f756a83dee5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f657 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.609845:0:5792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa000/0x51de7f756a83dee5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f657 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916988.609923:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1875815140756480:192.168.202.40@tcp:105: 00000100:00100000:0.0:1788916988.609990:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6480 going to sleep for 11 seconds 00000100:00100000:2.0:1788916988.616824:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1875815140756480:192.168.202.40@tcp:105: 00000100:00100000:3.0:1788916988.617291:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:2.0:1788916988.618598:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83dede lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.618614:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83dede lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.618654:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dfa2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.618668:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dfa2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.618680:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dfa2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.618691:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dfa2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.618698:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dfa2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.618705:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dfa2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.618711:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916988.618714:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dfa2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.618738:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dfa2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.618751:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:2.0:1788916988.618754:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916988.618757:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dfa2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.618763:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dfa2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.618774:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83df94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.618780:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83df94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.618787:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83df94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.618791:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916988.618794:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83df94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.618800:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83df94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.618806:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:2.0:1788916988.618809:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788916988.618811:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83df94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.618824:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83df94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916988.622414:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:10573:x1875815113483008:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 27191us (27493us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788916988.622428:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 127 00000020:00080000:2.0:1788916988.622435:0:5792:0:(tgt_main.c:816:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788916988.622634:0:11537:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788916988.622640:0:11537:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788916988.623270:0:11537:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788916988.623278:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788916988.625674:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113483264 00000100:00100000:1.0:1788916988.625692:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113483264 00000100:00100000:1.0:1788916988.625757:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:3.0:1788916988.625763:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1788916988.625770:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:10572:x1875815113483264:12345-192.168.202.40@tcp:49:lfs.0 00000100:00100000:3.0:1788916988.625777:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:1.0:1788916988.625918:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:10572:x1875815113483264:12345-192.168.202.40@tcp:49:lfs.0 Request processed in 152us (8628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916988.625925:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:3.0:1788916988.626326:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916988.627521:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113483520 00000100:00100000:1.0:1788916988.627533:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113483520 00000100:00100000:1.0:1788916988.627588:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:1.0:1788916988.627598:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e08cfe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:10573:x1875815113483520:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788916988.628386:0:5795:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788916988.628510:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788916988.628572:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83dfa9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.628591:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83dfa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.628605:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83dfa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.628622:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83dfa9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.628629:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83dfa9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.628636:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83dfa9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.628664:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788916988.628784:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e08cfe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:10573:x1875815113483520:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 1184us (2455us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788916988.628794:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 32 00000020:00080000:1.0:1788916988.628800:0:5795:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788916988.628950:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788916988.628957:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83dfa9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.628965:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788916988.628968:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83dfa9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.628977:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83dfa9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.628990:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a6e1959ef00) 00010000:00010000:0.0:1788916988.628993:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788916988.628997:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83dfa9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.629003:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83dfa9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916988.629020:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916988.629022:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788916988.629023:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916988.629806:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916988.629994:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113483776 00000100:00100000:2.0:1788916988.630003:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113483776 00000100:00100000:2.0:1788916988.630054:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:2.0:1788916988.630064:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:10572:x1875815113483776:12345-192.168.202.40@tcp:58:lfs.0 00000040:00080000:2.0:1788916988.630334:0:8069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788916988.630415:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:10572:x1875815113483776:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 353us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916988.630422:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:3.0:1788916988.674281:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916988.674653:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113483904 00000100:00100000:2.0:1788916988.674664:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113483904 00000100:00100000:2.0:1788916988.674720:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:2.0:1788916988.674728:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:10575:x1875815113483904:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788916988.674751:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916988.674768:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dfb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f68f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.674823:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83dfb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.674835:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83dfb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.674874:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83dfb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.674890:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83dfbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.674897:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83dfbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.674902:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83dfbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.675195:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83dfc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.675204:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83ded0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f650 expref: 21 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.675210:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83dfc5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.675239:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83ded0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f650 expref: 21 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.675249:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83ded0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f650 expref: 21 pid: 5792 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916988.675260:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd31180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1875815140756608:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788916988.675331:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e096e3180 going to sleep for 11 seconds 00000100:00100000:0.0:1788916988.683654:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916988.683962:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd31180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1875815140756608:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788916988.683992:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83dfc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916988.684084:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113484160 00000100:00100000:1.0:1788916988.684094:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113484160 00000100:00100000:1.0:1788916988.684203:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:1.0:1788916988.684214:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+22:5590:x1875815113484160:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788916988.684465:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+23:5590:x1875815113484160:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 252us (820us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788916988.684473:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:3.0:1788916988.687686:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916988.687912:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113484288 00000100:00100000:1.0:1788916988.687924:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113484288 00010000:00010000:1.0:1788916988.687971:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83ded0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f650 expref: 23 pid: 5792 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916988.688027:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:1.0:1788916988.688038:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e408e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+23:2373:x1875815113484288:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788916988.688079:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916988.688087:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83ded0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f650 expref: 23 pid: 5792 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.688101:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83ded0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f650 expref: 23 pid: 5792 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.688127:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83ded0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f650 expref: 23 pid: 5792 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.688290:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:1.0:1788916988.688297:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83dfc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.688308:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83dfc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.688317:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83dfc5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916988.688380:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916988.688439:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e408e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+22:2373:x1875815113484288:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 402us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916988.688447:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00010000:00010000:2.0:1788916988.689358:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83dfc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689372:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83dfc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916988.689440:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788916988.689445:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788916988.689474:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83dfc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689491:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83dfc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689503:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83dfb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689510:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83dfb7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689678:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83dfb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689684:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916988.689688:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83dfb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689697:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83dfb7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689728:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:2.0:1788916988.689731:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916988.689735:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83dfb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689742:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83dfb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689758:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83dfbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689764:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83dfbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689770:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83dfbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689774:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168ec00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916988.689777:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83dfbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689783:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83dfbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689789:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a6e02f3c500) 00010000:00010000:2.0:1788916988.689792:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916988.689795:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83dfbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689801:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83dfbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689901:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dfb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f68f expref: 22 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689917:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83dfc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f68f expref: 21 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916988.689925:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:2.0:1788916988.689927:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788916988.689930:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168e200, rc 0) 00000100:00100000:2.0:1788916988.690043:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+21:10575:x1875815113483904:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 15314us (15771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916988.690051:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 129 00010000:00010000:2.0:1788916988.703530:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916989.471344:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e03854700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140756864:0@lo:400:kworker.0 00000100:00100000:3.0:1788916989.471360:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e03857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140756736:0@lo:400:kworker.0 00000100:00100000:0.0:1788916989.471952:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916989.471958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916989.471989:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140756864 00000100:00100000:2.0:1788916989.471997:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140756864 00000100:00100000:2.0:1788916989.472050:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788916989.472058:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140756864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916989.472389:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140757248:0@lo:400:kworker.0 00000100:00100000:0.0:1788916989.472393:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140757376:0@lo:400:kworker.0 00000100:00100000:3.0:1788916989.472434:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916989.472443:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916989.472475:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788916989.472476:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788916989.472486:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e03857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140756992:0@lo:400:kworker.0 00000100:00100000:3.0:1788916989.472488:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140757120:0@lo:400:kworker.0 00000100:00100000:3.0:1788916989.472519:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916989.472523:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140757248 00000100:00100000:1.0:1788916989.472528:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140757248 00000100:00100000:3.0:1788916989.472575:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140756736 00000100:00100000:3.0:1788916989.472580:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140756736 00000100:00100000:1.0:1788916989.472586:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788916989.472596:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140757248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916989.472618:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788916989.472639:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140756736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788916989.472646:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140757248:12345-0@lo:400:kworker.0 Request processed in 52us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916989.472662:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788916989.472663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916989.472682:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140756992 00000100:00100000:1.0:1788916989.472686:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140756992 00000100:00100000:3.0:1788916989.472693:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140756736:12345-0@lo:400:kworker.0 Request processed in 57us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916989.472702:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788916989.472708:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788916989.472717:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140756992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916989.472718:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140757376 00000100:00100000:0.0:1788916989.472721:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140757376 00000100:00100000:3.0:1788916989.472746:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140757120 00000100:00100000:3.0:1788916989.472751:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140757120 00000100:00100000:0.0:1788916989.472756:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788916989.472757:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140756992:12345-0@lo:400:kworker.0 Request processed in 41us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916989.472764:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788916989.472766:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875815140757376:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788916989.472784:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788916989.472789:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788916989.472793:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788916989.472803:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875815140757376:12345-0@lo:400:kworker.0 Request processed in 37us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916989.472806:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140757120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916989.472814:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788916989.472825:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e03857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140756736:0@lo:400:kworker.0 00000100:00100000:1.0:1788916989.472840:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140757248:0@lo:400:kworker.0 00000100:00100000:3.0:1788916989.472853:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140757120:12345-0@lo:400:kworker.0 Request processed in 50us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916989.472860:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788916989.472870:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140757120:0@lo:400:kworker.0 00000100:00100000:1.0:1788916989.472898:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e03857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140756992:0@lo:400:kworker.0 00000100:00100000:1.0:1788916989.472907:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140757376:0@lo:400:kworker.0 00000100:00100000:2.0:1788916989.473252:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140756864:12345-0@lo:400:kworker.0 Request processed in 1193us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916989.473259:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788916989.473603:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e03854700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140756864:0@lo:400:kworker.0 00000040:00080000:1.0:1788916989.487127:0:11961:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788916989.487261:0:11961:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788916989.487319:0:11961:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788916989.487327:0:11961:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788916989.663646:0:11537:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788916989.663656:0:11537:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788916989.663719:0:11537:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788916989.663730:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788916989.663896:0:11537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a82680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1875815140757504:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788916989.664005:0:11537:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36fe6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788916989.666872:0:11537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a82680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1875815140757504:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788916989.668123:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916989.668340:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113484416 00000100:00100000:0.0:1788916989.668352:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113484416 00000100:00100000:0.0:1788916989.668393:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 130 00000100:00100000:0.0:1788916989.668400:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+21:10587:x1875815113484416:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788916989.668608:0:5793:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788916989.668841:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+21:10587:x1875815113484416:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 375us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916989.668849:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 130 00000100:00100000:0.0:1788916989.680101:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916989.680214:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113484672 00000100:00100000:1.0:1788916989.680226:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113484672 00000100:00100000:2.0:1788916989.680413:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 131 00000100:00100000:2.0:1788916989.680426:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+21:10587:x1875815113484672:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788916989.680464:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916989.680487:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dfcc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f696 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916989.680633:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83dfd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916989.680651:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83dfd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916989.680666:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83dfd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916989.680689:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788916989.680842:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83dfcc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f696 expref: 24 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916989.680863:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83dfd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f696 expref: 23 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916989.680873:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:2.0:1788916989.680876:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788916989.680879:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168ec00, rc 0) 00000100:00100000:2.0:1788916989.680947:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+23:10587:x1875815113484672:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 524us (857us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788916989.680955:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 131 00000100:00100000:3.0:1788916989.687525:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916989.687978:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113484800 00000100:00100000:1.0:1788916989.687989:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113484800 00000100:00100000:1.0:1788916989.688059:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:1.0:1788916989.688070:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+23:2374:x1875815113484800:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788916989.688095:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916989.688122:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83dfd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f696 expref: 23 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916989.688177:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:1.0:1788916989.688183:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916989.688430:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+22:2374:x1875815113484800:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 360us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916989.688438:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:3.0:1788916989.693716:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916989.693782:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113485056 00000100:00100000:0.0:1788916989.693793:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113485056 00000100:00100000:0.0:1788916989.693853:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 132 00000100:00100000:0.0:1788916989.693864:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+22:10587:x1875815113485056:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788916989.693954:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dfe1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916989.693982:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dfe1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916989.693994:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dfe1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916989.694817:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dfe1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916989.694828:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dfe1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916989.694834:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dfe1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916989.694841:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916989.694845:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dfe1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916989.694853:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dfe1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916989.694867:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:0.0:1788916989.694870:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788916989.694874:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dfe1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916989.694880:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83dfe1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916989.695424:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+23:10587:x1875815113485056:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 1550us (1708us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788916989.695444:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 132 00000040:00080000:1.0:1788916989.696861:0:11537:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788916989.696870:0:11537:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788916989.697921:0:11537:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788916989.697935:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788916989.715209:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916989.715275:0:11923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113485312 00000100:00100000:2.0:1788916989.715283:0:11923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113485312 00000100:00100000:2.0:1788916989.715325:0:11923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:2.0:1788916989.715332:0:11923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+23:10587:x1875815113485312:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788916989.715573:0:11923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+24:10587:x1875815113485312:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 241us (371us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788916989.715589:0:11923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00010000:00010000:0.0:1788916989.728218:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916989.983607:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788916989.983637:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140757632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788916989.983724:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916989.984355:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140757632 00000100:00100000:0.0:1788916989.984364:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140757632 00000100:00100000:0.0:1788916989.984526:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788916989.984584:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875815140757632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788916989.984628:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788916989.984700:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875815140757632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916989.984716:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788916989.984796:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140757632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788916990.495600:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788916990.495627:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140757760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788916990.495700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916990.495938:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140757760 00000100:00100000:0.0:1788916990.495946:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140757760 00000100:00100000:0.0:1788916990.496004:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788916990.496015:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140757760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788916990.496051:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788916990.496103:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f326680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140757760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916990.496110:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788916990.496591:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140757760:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788916990.751461:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788916991.127348:0:12013:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788916991.127363:0:12013:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788916991.127436:0:12013:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788916991.127447:0:12013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788916991.268344:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916991.268449:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113485568 00000100:00100000:0.0:1788916991.268462:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113485568 00000100:00080000:1.0:1788916991.268550:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788916991.268604:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 133 00000100:00100000:0.0:1788916991.268618:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+24:10607:x1875815113485568:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1788916991.268650:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916991.268677:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dfe8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f69d expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916991.268840:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dfef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916991.268858:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dfef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916991.268873:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dfef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788916991.268886:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788916991.269048:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83dfe8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f69d expref: 27 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916991.269067:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dfef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f69d expref: 26 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916991.269078:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:0.0:1788916991.269081:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788916991.269092:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3c00, rc 0) 00000100:00100000:0.0:1788916991.269192:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+26:10607:x1875815113485568:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 578us (862us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788916991.269201:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 133 00000100:00100000:2.0:1788916991.274635:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916991.274800:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113485696 00000100:00100000:0.0:1788916991.274813:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113485696 00000100:00100000:0.0:1788916991.274878:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00100000:0.0:1788916991.274891:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+26:10607:x1875815113485696:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:0.0:1788916991.274983:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dffd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916991.275013:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916991.275028:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916991.275065:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916991.275072:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dffd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916991.275080:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dffd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916991.275087:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916991.275092:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dffd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916991.275100:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dffd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916991.275115:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:0.0:1788916991.275118:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788916991.275123:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dffd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916991.275130:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83dffd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788916991.275238:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+26:10607:x1875815113485696:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 350us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916991.275251:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00100000:0.0:1788916991.340754:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916991.340980:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113485824 00000100:00100000:2.0:1788916991.340994:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113485824 00000100:00080000:1.0:1788916991.341195:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788916991.341400:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:2.0:1788916991.341416:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2372:x1875815113485824:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:2.0:1788916991.341442:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916991.341474:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83e004 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f6a4 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788916991.341506:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa0b4fa, atime: 0x6aa0b4fa, ctime: 0x6aa0b4fa, blocks: 0xb 00010000:00010000:2.0:1788916991.341542:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=387s v=(0 0) 00010000:00010000:2.0:1788916991.341547:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788916991.341560:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83e004 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6a4 expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916991.341581:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83e004 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6a4 expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916991.341622:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168fc00, rc 0) 00000100:00100000:2.0:1788916991.341703:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2372:x1875815113485824:12345-192.168.202.40@tcp:101:cat.0 Request processed in 293us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916991.341711:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:0.0:1788916991.345994:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916991.346232:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113485952 00000100:00100000:2.0:1788916991.346247:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113485952 00002000:00100000:2.0:1788916991.346317:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9a6d01a81c00 x1875815113485952/t0(0) o3->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:372/0 lens 488/0 e 0 to 0 dl 1788917002 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788916991.346331:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6d01a81c00 with x1875815113485952 ext(0->4095) 00002000:00010000:2.0:1788916991.346339:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6d01a81c00 00000100:00100000:2.0:1788916991.346387:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:2.0:1788916991.346399:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113485952:12345-192.168.202.40@tcp:3:cat.0 00000100:00100000:2.0:1788916991.346792:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113485952:12345-192.168.202.40@tcp:3:cat.0 Request processed in 395us (814us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788916991.346801:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00002000:00100000:2.0:1788916991.346808:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9a6d01a81c00 x1875815113485952/t0(0) o3->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:372/0 lens 488/4536 e 0 to 0 dl 1788917002 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788916991.346816:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6d01a81c00 with x1875815113485952 ext(0->4095) 00002000:00010000:2.0:1788916991.346820:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6d01a81c00 00000100:00100000:3.0:1788916991.372012:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916991.372081:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916991.372128:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916991.372214:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113486336 00000100:00100000:1.0:1788916991.372247:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113486336 00000100:00100000:0.0:1788916991.372395:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113486208 00000100:00100000:0.0:1788916991.372401:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113486208 00000100:00100000:1.0:1788916991.372418:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:1.0:1788916991.372433:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2372:x1875815113486336:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788916991.372559:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2372:x1875815113486336:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 130us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916991.372567:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00080000:3.0:1788916991.372757:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788916991.372762:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788916991.374726:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113486080 00000100:00100000:2.0:1788916991.374745:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113486080 00000100:00100000:2.0:1788916991.374834:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 286 00000100:00100000:2.0:1788916991.374846:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:2372:x1875815113486080:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788916991.374966:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:2372:x1875815113486080:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 122us (2883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916991.374976:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 286 00000100:00100000:1.0:1788916991.380665:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 74 00000100:00100000:1.0:1788916991.380692:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2372:x1875815113486208:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788916991.380814:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f624380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2372:x1875815113486208:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 133us (8818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916991.380823:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 74 00010000:00010000:0.0:1788916991.775953:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788916992.799545:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788916993.100667:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1788916993.634945:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1788916993.634980:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1788916993.648911:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788916993.648943:0:5814:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6e36cf6d80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788916993.648949:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e3f795900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e36cf6e40 00000020:00080000:0.0:1788916993.648954:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e3f795100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e36fd6800 00000020:00080000:0.0:1788916993.649031:0:5814:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1788916993.649084:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788916993.649416:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1788916993.827545:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916994.591437:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140758016:0@lo:400:kworker.0 00000100:00100000:0.0:1788916994.591540:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140758272:0@lo:400:kworker.0 00000100:00100000:3.0:1788916994.591559:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916994.592289:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3727a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140758144:0@lo:400:kworker.0 00000100:00100000:1.0:1788916994.592393:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140757888:0@lo:400:kworker.0 00000100:00100000:0.0:1788916994.593724:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916994.593844:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140758272 00000100:00100000:0.0:1788916994.593853:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140758272 00000100:00100000:0.0:1788916994.593931:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788916994.593943:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140758272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916994.594577:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140758272:12345-0@lo:400:kworker.0 Request processed in 634us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916994.594586:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788916994.594648:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788916994.594654:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6e3f324a80, transno 4294967304 00000100:00100000:0.0:1788916994.594669:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140758272:0@lo:400:kworker.0 00000100:00100000:3.0:1788916994.595100:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1edf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140758528:0@lo:400:kworker.0 00000100:00100000:3.0:1788916994.595159:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916994.595323:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140758016 00000100:00100000:3.0:1788916994.595332:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140758016 00000100:00100000:3.0:1788916994.595376:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788916994.595385:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140758016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916994.595434:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140758016:12345-0@lo:400:kworker.0 Request processed in 51us (3876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916994.595441:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1788916994.595470:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788916994.595511:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140758016:0@lo:400:kworker.0 00000100:00100000:0.0:1788916994.596341:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140758528 00000100:00100000:0.0:1788916994.596351:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140758528 00000100:00100000:0.0:1788916994.596408:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788916994.596423:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3720ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140758528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788916994.596497:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3720ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140758528:12345-0@lo:400:kworker.0 Request processed in 63us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916994.596504:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788916994.596638:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788916994.596670:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788916994.596677:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788916994.596699:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1edf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140758528:0@lo:400:kworker.0 00000100:00100000:2.0:1788916994.596732:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916994.597921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788916994.597982:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3727b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140758400:0@lo:400:kworker.0 00000100:00100000:1.0:1788916994.598038:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916994.598065:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140758144 00000100:00100000:3.0:1788916994.598073:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140758144 00000100:00100000:3.0:1788916994.598166:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140758400 00000100:00100000:3.0:1788916994.598169:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140758400 00000100:00100000:3.0:1788916994.598207:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788916994.598216:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140758144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916994.598257:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140757888 00000100:00100000:2.0:1788916994.598261:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140757888 00000100:00100000:3.0:1788916994.598277:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140758144:12345-0@lo:400:kworker.0 Request processed in 63us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916994.598284:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788916994.598291:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788916994.598297:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140757888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916994.598307:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788916994.598312:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140758400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916994.598335:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140757888:12345-0@lo:400:kworker.0 Request processed in 38us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916994.598337:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140758400:12345-0@lo:400:kworker.0 Request processed in 25us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916994.598342:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788916994.598343:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788916994.598404:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3727a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140758144:0@lo:400:kworker.0 00000100:00080000:1.0:1788916994.598468:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788916994.598497:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140757888:0@lo:400:kworker.0 00000100:00100000:1.0:1788916994.598510:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3727b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140758400:0@lo:400:kworker.0 00010000:00010000:3.0:1788916994.847545:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788916995.103856:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788916995.103890:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140758656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788916995.103977:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788916995.104048:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140758656 00000100:00100000:0.0:1788916995.104057:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140758656 00000100:00100000:0.0:1788916995.104109:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788916995.104119:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3727b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140758656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788916995.104190:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788916995.104242:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3727b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140758656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916995.104251:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788916995.104309:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140758656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788916995.362790:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916995.362915:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113486464 00000100:00100000:3.0:1788916995.362930:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113486464 00000100:00100000:3.0:1788916995.363046:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 135 00000100:00100000:3.0:1788916995.363060:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+13:10250:x1875815113486464:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1788916995.363388:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788916995.363595:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+13:10250:x1875815113486464:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 Request processed in 535us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916995.363604:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 135 00000100:00100000:3.0:1788916995.367924:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916995.368066:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113486720 00000100:00100000:2.0:1788916995.368088:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113486720 00000100:00100000:2.0:1788916995.368212:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:2.0:1788916995.368225:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+13:10250:x1875815113486720:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788916995.368875:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:10250:x1875815113486720:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 650us (964us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788916995.368895:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:1.0:1788916995.615528:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788916995.615563:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140758784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788916995.615674:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916995.618061:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140758784 00000100:00100000:2.0:1788916995.618081:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140758784 00000100:00100000:2.0:1788916995.618178:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788916995.618196:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140758784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788916995.618247:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788916995.618362:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140758784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (2687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916995.618371:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788916995.618700:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140758784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788916995.631679:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916995.631791:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113486848 00000100:00100000:3.0:1788916995.631813:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113486848 00000100:00080000:1.0:1788916995.631975:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788916995.632029:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 136 00000100:00100000:3.0:1788916995.632042:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+5:11059:x1875815113486848:12345-192.168.202.40@tcp:101:lsof.0 00010000:00010000:3.0:1788916995.632073:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916995.632101:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e00b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f6ab expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916995.632220:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e012 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916995.632248:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916995.632264:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916995.632548:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788916995.632552:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788916995.632656:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916995.632686:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e00b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ab expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916995.632715:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e012 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ab expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916995.632724:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:3.0:1788916995.632727:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788916995.632731:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f800, rc 0) 00000100:00100000:3.0:1788916995.632860:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+6:11059:x1875815113486848:12345-192.168.202.40@tcp:101:lsof.0 Request processed in 820us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916995.632869:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 136 00010000:00010000:3.0:1788916995.875351:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916996.487913:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916996.487963:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916996.488002:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916996.488028:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916996.488052:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916996.488197:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113486976 00000100:00100000:0.0:1788916996.488211:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113486976 00000100:00100000:0.0:1788916996.488271:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 288 00000100:00100000:0.0:1788916996.488283:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ff41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+13:2372:x1875815113486976:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916996.488382:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ff41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+13:2372:x1875815113486976:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 101us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916996.488390:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 288 00000100:00100000:0.0:1788916996.488432:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113487232 00000100:00100000:0.0:1788916996.488436:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113487232 00000100:00100000:0.0:1788916996.488489:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113487360 00000100:00100000:0.0:1788916996.488510:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113487360 00000100:00100000:0.0:1788916996.488543:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:0.0:1788916996.488549:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2372:x1875815113487232:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916996.488583:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2372:x1875815113487232:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 34us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916996.488590:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:0.0:1788916996.488603:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:0.0:1788916996.488609:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3720a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2372:x1875815113487360:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916996.488637:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3720a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2372:x1875815113487360:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 29us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916996.488643:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:0.0:1788916996.488670:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113487488 00000100:00100000:0.0:1788916996.488673:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113487488 00000100:00100000:0.0:1788916996.488697:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113487104 00000100:00100000:0.0:1788916996.488699:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113487104 00000100:00100000:0.0:1788916996.488716:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 133 00000100:00100000:0.0:1788916996.488722:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e1d3733-3759-4aa4-b321-e9a62c258363+6:2372:x1875815113487488:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916996.488751:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37209880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e1d3733-3759-4aa4-b321-e9a62c258363+6:2372:x1875815113487488:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916996.488756:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 133 00000100:00100000:0.0:1788916996.488767:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00100000:0.0:1788916996.488772:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3720bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:2372:x1875815113487104:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788916996.488797:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3720bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:2372:x1875815113487104:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788916996.488803:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00080000:0.0:1788916996.488826:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788916996.488831:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788916996.897593:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788916997.701362:0:12214:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:23:15 (1788916995) 00010000:00010000:3.0:1788916997.920559:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788916998.432828:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916998.432913:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113487744 00000100:00100000:0.0:1788916998.432924:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113487744 00000100:00100000:0.0:1788916998.433203:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 137 00000100:00100000:0.0:1788916998.433217:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:11323:x1875815113487744:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788916998.433241:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788916998.433265:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e019 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f6b2 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.433472:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e020 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.433489:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e020 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.433504:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e020 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.433521:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e027 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.433529:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e027 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.433537:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e027 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.434083:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e02e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.434094:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e02e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.434108:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e02e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788916998.434119:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1788916998.434676:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e020 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.434687:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e020 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.434695:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e020 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.434702:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916998.434706:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e020 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.434715:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e020 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.434731:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6e02cee500) 00010000:00010000:0.0:1788916998.434734:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916998.434746:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e020 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.434753:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e020 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.434769:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e027 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.434776:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e027 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.434791:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e027 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.434796:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788916998.434799:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e027 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.434805:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e027 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.434813:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a6e03d86600) 00010000:00010000:0.0:1788916998.434816:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916998.434819:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e027 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.434825:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e027 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788916998.435189:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788916998.435688:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e019 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6b2 expref: 17 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.435708:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e02e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6b2 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788916998.435716:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:0.0:1788916998.435718:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788916998.435721:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3200, rc 0) 00000100:00100000:0.0:1788916998.435803:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:11323:x1875815113487744:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 2589us (2984us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788916998.435821:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 137 00000100:00100000:0.0:1788916998.443529:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788916998.443577:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916998.443663:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113488000 00000100:00100000:1.0:1788916998.443676:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113488000 00000100:00100000:1.0:1788916998.443763:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:1.0:1788916998.443775:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37278000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+16:2371:x1875815113488000:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788916998.443792:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788916998.443822:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e02e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6b2 expref: 16 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916998.443843:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:1.0:1788916998.443849:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788916998.443917:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37278000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+15:2371:x1875815113488000:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 144us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788916998.443925:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:2.0:1788916998.443997:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113487872 00000100:00100000:2.0:1788916998.444002:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113487872 00000100:00100000:2.0:1788916998.444041:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00100000:2.0:1788916998.444050:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3727a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+15:11323:x1875815113487872:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788916998.444119:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3727a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+15:11323:x1875815113487872:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 71us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916998.444125:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 138 00000001:00080000:1.0:1788916998.720958:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1788916998.720986:0:5814:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788916998.721417:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788916998.721433:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:1.0:1788916998.946885:0:11537:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788916998.946893:0:11537:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788916998.947317:0:11537:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788916998.947327:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788916998.947468:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788916999.711345:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140759168:0@lo:400:kworker.0 00000100:00100000:3.0:1788916999.711421:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916999.711495:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788916999.711501:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3720b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140759040:0@lo:400:kworker.0 00000100:00100000:3.0:1788916999.711522:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916999.711537:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140759552:0@lo:400:kworker.0 00000100:00100000:3.0:1788916999.711559:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788916999.711600:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140759168 00000100:00100000:3.0:1788916999.711608:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140759168 00000100:00100000:3.0:1788916999.711659:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140759040 00000100:00100000:3.0:1788916999.711662:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140759040 00000100:00100000:3.0:1788916999.711682:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788916999.711690:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140759168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916999.711739:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140759168:12345-0@lo:400:kworker.0 Request processed in 50us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916999.711748:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788916999.711768:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788916999.711773:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3720b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140759040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916999.711801:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3720b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140759040:12345-0@lo:400:kworker.0 Request processed in 28us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916999.711807:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788916999.711828:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140759552 00000100:00100000:3.0:1788916999.711832:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140759552 00000100:00100000:3.0:1788916999.711860:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788916999.711866:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3720aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140759552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916999.711895:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3720aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140759552:12345-0@lo:400:kworker.0 Request processed in 29us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916999.711901:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788916999.711915:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788916999.711920:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788916999.711954:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3720b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140759040:0@lo:400:kworker.0 00000100:00100000:3.0:1788916999.711964:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37209500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140759552:0@lo:400:kworker.0 00000100:00100000:3.0:1788916999.711973:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37209c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140759168:0@lo:400:kworker.0 00000100:00100000:2.0:1788916999.712076:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3720b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140759296:0@lo:400:kworker.0 00000100:00100000:2.0:1788916999.712105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916999.712135:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788916999.712140:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140758912:0@lo:400:kworker.0 00000100:00100000:2.0:1788916999.712200:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916999.712227:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3720a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140759424:0@lo:400:kworker.0 00000100:00100000:2.0:1788916999.712246:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788916999.712266:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140759424 00000100:00100000:2.0:1788916999.712269:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140759424 00000100:00100000:2.0:1788916999.712303:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788916999.712308:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140759424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916999.712338:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140759424:12345-0@lo:400:kworker.0 Request processed in 29us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916999.712343:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788916999.712370:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140758912 00000100:00100000:2.0:1788916999.712372:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140758912 00000100:00100000:2.0:1788916999.712392:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788916999.712397:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140758912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788916999.712419:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:3304:x1875815140758912:12345-0@lo:400:kworker.0 Request processed in 23us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916999.712425:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:2.0:1788916999.712459:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788916999.712473:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140758912:0@lo:400:kworker.0 00000100:00100000:2.0:1788916999.712481:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3720a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140759424:0@lo:400:kworker.0 00000100:00100000:3.0:1788916999.712635:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140759296 00000100:00100000:3.0:1788916999.712639:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140759296 00000100:00100000:3.0:1788916999.712670:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788916999.712677:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140759296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788916999.712711:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140759296:12345-0@lo:400:kworker.0 Request processed in 35us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916999.712717:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788916999.712882:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788916999.712900:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3720b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140759296:0@lo:400:kworker.0 00000100:00100000:0.0:1788916999.787026:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788916999.787084:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113488128 00000100:00100000:1.0:1788916999.787099:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113488128 00000100:00100000:1.0:1788916999.787195:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 139 00000100:00100000:1.0:1788916999.787206:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+13:11366:x1875815113488128:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1788916999.787239:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788916999.787262:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83e03c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f6b9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.787330:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e043 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.787344:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e043 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.787358:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e043 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.787373:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e04a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.787381:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e04a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.787388:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e04a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.787890:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e043 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.787899:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e043 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.787906:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e043 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.787912:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaa600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916999.787924:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e043 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.787933:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e043 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.787947:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:1.0:1788916999.787951:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788916999.787955:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e043 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.787962:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e043 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.787973:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e04a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.787979:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e04a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.787986:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e04a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.787992:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaac00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788916999.787995:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e04a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.788002:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e04a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.788010:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a6e1959e900) 00010000:00010000:1.0:1788916999.788012:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788916999.788021:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e04a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.788028:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e04a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.788058:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83e03c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6b9 expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.788070:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:1.0:1788916999.788072:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788916999.788076:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab400/0x51de7f756a83e03c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6b9 expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788916999.788086:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeab400, rc 0) 00000100:00100000:1.0:1788916999.788242:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36ef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+13:11366:x1875815113488128:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1036us (1223us total) trans 0 rc 301/301 00000100:00100000:1.0:1788916999.788251:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 139 00000100:00100000:1.0:1788916999.794402:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916999.794515:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113488384 00000100:00100000:2.0:1788916999.794526:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113488384 00000100:00100000:2.0:1788916999.794618:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 140 00000100:00100000:2.0:1788916999.794629:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+13:11366:x1875815113488384:12345-192.168.202.40@tcp:36:lfs.0 00010000:00010000:2.0:1788916999.794702:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916999.794757:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e400/0x51de7f756a83d9ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4f2 expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.794775:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:2.0:1788916999.794781:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788916999.795080:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e051 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.795095:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e012 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ab expref: 5 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.795104:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e051 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.795136:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e012 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ab expref: 5 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.795183:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e012 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ab expref: 5 pid: 5793 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916999.795199:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1875815140759680:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788916999.795284:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36fe6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788916999.797956:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916999.798019:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113488512 00000100:00100000:3.0:1788916999.798029:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113488512 00010000:00010000:3.0:1788916999.798089:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e012 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ab expref: 6 pid: 5793 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916999.798125:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:3.0:1788916999.798135:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e1d3733-3759-4aa4-b321-e9a62c258363+6:2373:x1875815113488512:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788916999.798312:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788916999.798321:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e012 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ab expref: 6 pid: 5793 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.798334:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e012 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ab expref: 6 pid: 5793 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.798355:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:3.0:1788916999.798360:0:6606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e051 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.798369:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e051 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.798386:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e051 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.798403:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788916999.798456:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e1d3733-3759-4aa4-b321-e9a62c258363+6:2373:x1875815113488512:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 322us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916999.798463:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00080000:1.0:1788916999.798521:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788916999.798597:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e012 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ab expref: 5 pid: 5793 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916999.798616:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1875815140759680:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788916999.798640:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e051 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.798661:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e051 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.798665:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e051 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.798694:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e058 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.798700:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e058 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.798707:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e058 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916999.801175:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788916999.801191:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e051 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.801201:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e051 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.801209:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e051 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.801216:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916999.801221:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e051 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.801228:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e051 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.801253:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:2.0:1788916999.801257:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916999.801262:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e051 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.801268:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e051 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788916999.801288:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000bdb2429 reply state 0000000028491265 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e058 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916999.801298:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788916999.801410:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:11366:x1875815113488384:12345-192.168.202.40@tcp:36:lfs.0 Request processed in 6778us (7012us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788916999.801422:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 140 00010000:00010000:2.0:1788916999.804255:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e058 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.804280:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e058 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.804289:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e058 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.804296:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168ec00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916999.804302:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e058 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.804309:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e058 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.804342:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a6e02f3ce00) 00010000:00010000:2.0:1788916999.804345:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916999.804351:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e058 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.804359:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e058 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916999.864190:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916999.864357:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113488640 00000100:00100000:2.0:1788916999.864369:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113488640 00000100:00100000:2.0:1788916999.864434:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 141 00000100:00100000:2.0:1788916999.864455:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+13:11374:x1875815113488640:12345-192.168.202.40@tcp:101:lctl.0 00010000:00010000:2.0:1788916999.864483:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788916999.864507:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e05f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f6c0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.864584:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e066 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.864597:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e066 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.864606:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e066 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788916999.864669:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788916999.864672:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1788916999.864693:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e066 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.864726:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e05f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6c0 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.864740:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e066 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6c0 expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.864747:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02f3ce00) 00010000:00010000:2.0:1788916999.864749:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788916999.864752:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f600, rc 0) 00000100:00100000:2.0:1788916999.865263:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:11374:x1875815113488640:12345-192.168.202.40@tcp:101:lctl.0 Request processed in 807us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916999.865272:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 141 00000100:00100000:1.0:1788916999.908030:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916999.908271:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113488768 00000100:00100000:3.0:1788916999.908349:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113488768 00000100:00100000:3.0:1788916999.908465:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00100000:3.0:1788916999.908476:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:11380:x1875815113488768:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1788916999.908499:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916999.908532:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e06d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f6c7 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.908612:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e074 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.908628:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e074 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.908652:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e074 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.908670:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e07b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.908679:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e07b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.908706:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e07b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.908825:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e400/0x51de7f756a83e082 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.908834:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e400/0x51de7f756a83e082 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.908842:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e400/0x51de7f756a83e082 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788916999.908873:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1788916999.908878:0:8069:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788916999.908902:0:8069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e400/0x51de7f756a83e082 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.908915:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e074 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.908921:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e074 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.908928:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e074 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.908935:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916999.908939:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e074 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.908948:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e074 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.908968:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02f3ce00) 00010000:00010000:3.0:1788916999.908971:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916999.908988:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e074 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.908995:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e074 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.909009:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e07b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.909015:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e07b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.909021:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e07b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.909026:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916999.909029:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e07b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.909035:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e07b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.909043:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a6e02cee800) 00010000:00010000:3.0:1788916999.909045:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916999.909048:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e07b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.909054:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e07b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.909098:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e06d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6c7 expref: 16 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.909110:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e400/0x51de7f756a83e082 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6c7 expref: 15 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.909115:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:3.0:1788916999.909117:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788916999.909119:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e400, rc 0) 00000100:00100000:3.0:1788916999.909226:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+15:11380:x1875815113488768:12345-192.168.202.40@tcp:101:bash.0 Request processed in 751us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916999.909234:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00100000:1.0:1788916999.911965:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916999.912064:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113489024 00000100:00100000:3.0:1788916999.912074:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113489024 00000100:00100000:3.0:1788916999.912228:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 143 00000100:00100000:3.0:1788916999.912238:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+15:11380:x1875815113489024:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1788916999.912260:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916999.912280:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e089 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f6ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.912605:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e090 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.912619:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e090 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.912628:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e090 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.916406:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e097 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.916431:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.916454:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788916999.917447:0:5793:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788916999.917752:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e09e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.917769:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e09e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.917780:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e09e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.917828:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e090 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.917837:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e090 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.917846:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e090 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.917854:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18fc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788916999.917859:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e090 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.917887:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e090 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.917903:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:3.0:1788916999.917906:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788916999.917911:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e090 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.917917:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e090 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788916999.917934:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f643a69 reply state 000000006d25e628 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916999.917944:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788916999.917986:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e089 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ce expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.918001:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e09e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ce expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.918008:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceec00) 00010000:00010000:3.0:1788916999.918010:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788916999.918012:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f800, rc 0) 00000100:00100000:3.0:1788916999.918379:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:11380:x1875815113489024:12345-192.168.202.40@tcp:101:bash.0 Request processed in 6140us (6419us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788916999.918390:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 143 00010000:00010000:2.0:1788916999.920328:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.920347:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e097 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.920355:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e097 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.920361:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788916999.920366:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e097 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.920374:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e097 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.920391:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e02cee800) 00010000:00010000:2.0:1788916999.920411:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788916999.920416:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e097 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.920423:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e097 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788916999.921410:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916999.921568:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113489152 00000100:00100000:3.0:1788916999.921586:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113489152 00000100:00080000:1.0:1788916999.921631:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788916999.921690:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:3.0:1788916999.921702:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2372:x1875815113489152:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1788916999.921723:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916999.921744:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d505722e/0x51de7f756a83e0ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f6d5 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788916999.921773:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788916999.921794:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788916999.921797:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788916999.921805:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d505722e/0x51de7f756a83e0ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6d5 expref: 6 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.921820:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d505722e/0x51de7f756a83e0ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6d5 expref: 6 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.921830:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e200, rc 0) 00000100:00100000:3.0:1788916999.921880:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2372:x1875815113489152:12345-192.168.202.40@tcp:101:bash.0 Request processed in 181us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916999.921887:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:1.0:1788916999.926653:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788916999.926797:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113489280 00000100:00100000:3.0:1788916999.926808:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113489280 00000100:00100000:3.0:1788916999.926869:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:3.0:1788916999.926881:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:11380:x1875815113489280:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1788916999.926901:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788916999.926919:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f23f8dc2/0x51de7f756a83e0b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f6dc expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.926971:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d505722e/0x51de7f756a83e0ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6d5 expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.926983:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788916999.926988:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788916999.926994:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f23f8dc2/0x51de7f756a83e0b3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6dc expref: 7 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.927035:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d505722e/0x51de7f756a83e0ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6d5 expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.927064:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d505722e/0x51de7f756a83e0ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6d5 expref: 7 pid: 6593 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916999.927082:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37209c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8068:1875815140759808:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788916999.927225:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e02b9b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788916999.931543:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916999.931676:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113489408 00000100:00100000:2.0:1788916999.931684:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113489408 00010000:00010000:2.0:1788916999.931728:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d505722e/0x51de7f756a83e0ac lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6d5 expref: 8 pid: 6593 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916999.931776:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:2.0:1788916999.931784:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37308380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2373:x1875815113489408:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788916999.931797:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788916999.931818:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d505722e/0x51de7f756a83e0ac lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6d5 expref: 8 pid: 6593 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.931828:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d505722e/0x51de7f756a83e0ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6d5 expref: 8 pid: 6593 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.931849:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788916999.931853:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788916999.931860:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f23f8dc2/0x51de7f756a83e0b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6dc expref: 8 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.931867:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f23f8dc2/0x51de7f756a83e0b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6dc expref: 8 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788916999.931924:0:5778:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f23f8dc2/0x51de7f756a83e0b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6dc expref: 8 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788916999.931939:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5778:1875815140759936:192.168.202.40@tcp:105: 00000100:00100000:2.0:1788916999.932014:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36fe6c00 going to sleep for 11 seconds 00010000:00010000:3.0:1788916999.932282:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d505722e/0x51de7f756a83e0ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6d5 expref: 8 pid: 6593 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788916999.932297:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37209c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8068:1875815140759808:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788916999.932321:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f23f8dc2/0x51de7f756a83e0b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6dc expref: 7 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788916999.932332:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f400, rc 0) 00000100:00100000:3.0:1788916999.932364:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:11380:x1875815113489280:12345-192.168.202.40@tcp:101:bash.0 Request processed in 5488us (5724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788916999.932370:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:1.0:1788916999.936913:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788916999.937009:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5778:1875815140759936:192.168.202.40@tcp:105: 00000100:00100000:0.0:1788916999.937044:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113489664 00010000:00010000:2.0:1788916999.937047:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788916999.937054:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113489664 00000100:00100000:0.0:1788916999.937122:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:0.0:1788916999.937133:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+17:11380:x1875815113489664:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:2.0:1788916999.937178:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37308380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2373:x1875815113489408:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 5393us (5644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788916999.937186:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:0.0:1788916999.937525:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:11380:x1875815113489664:12345-192.168.202.40@tcp:35:bash.0 Request processed in 392us (621us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788916999.937533:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 36 00010000:00010000:3.0:1788916999.967562:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917000.000682:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917000.003078:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113489920 00000100:00100000:2.0:1788917000.003095:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113489920 00000100:00080000:1.0:1788917000.003182:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917000.003224:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 144 00000100:00100000:2.0:1788917000.003234:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:11390:x1875815113489920:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788917000.003260:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917000.003278:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e0ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f6e3 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917000.003433:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788917000.003573:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e0ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6e3 expref: 20 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.003586:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02f3ce00) 00010000:00010000:2.0:1788917000.003588:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788917000.003605:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e0ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6e3 expref: 20 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.003618:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168ec00, rc 0) 00000100:00100000:2.0:1788917000.003679:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36ef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:11390:x1875815113489920:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 447us (3009us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788917000.003688:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 144 00000100:00100000:1.0:1788917000.006563:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917000.006634:0:11923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113490176 00000100:00100000:0.0:1788917000.006648:0:11923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113490176 00000100:00100000:0.0:1788917000.006717:0:11923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:0.0:1788917000.006730:0:11923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:11390:x1875815113490176:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1788917000.007001:0:11923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:11390:x1875815113490176:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 273us (449us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788917000.007009:0:11923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:1.0:1788917000.069305:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917000.069788:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113490304 00000100:00100000:2.0:1788917000.069800:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113490304 00000100:00100000:2.0:1788917000.069862:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 145 00000100:00100000:2.0:1788917000.069875:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:11396:x1875815113490304:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788917000.069901:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917000.069927:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e0c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f6ea expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.070004:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e0cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.070018:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e0cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.070032:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e0cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917000.070097:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1788917000.070101:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788917000.070123:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e0cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.070194:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e0c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ea expref: 22 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.070234:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e0cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ea expref: 21 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.070243:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:2.0:1788917000.070246:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788917000.070250:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f200, rc 0) 00000100:00100000:2.0:1788917000.070324:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+21:11396:x1875815113490304:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 452us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917000.070331:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 145 00000100:00100000:1.0:1788917000.075841:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917000.075977:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113490560 00000100:00100000:3.0:1788917000.075987:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113490560 00000100:00100000:3.0:1788917000.076062:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 146 00000100:00100000:3.0:1788917000.076072:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+21:11396:x1875815113490560:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788917000.076095:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917000.076118:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e0d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f6f1 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.076282:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e0dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.076298:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e0dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.076311:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e0dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917000.076323:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788917000.076488:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e0d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6f1 expref: 24 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.076509:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e0dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6f1 expref: 23 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.076518:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceec00) 00010000:00010000:3.0:1788917000.076536:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788917000.076540:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18fc00, rc 0) 00000100:00100000:3.0:1788917000.076615:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+23:11396:x1875815113490560:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 544us (785us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788917000.076623:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 146 00000100:00100000:1.0:1788917000.084428:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917000.084566:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113490816 00000100:00100000:2.0:1788917000.084579:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113490816 00000100:00100000:2.0:1788917000.084657:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 147 00000100:00100000:2.0:1788917000.084670:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+23:11396:x1875815113490816:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788917000.084707:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917000.084743:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e0eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f6f8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.084877:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e0f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.084896:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e0f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.084910:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e0f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917000.084922:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788917000.085124:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e0eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6f8 expref: 26 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.085178:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e0f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6f8 expref: 25 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.085188:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceec00) 00010000:00010000:2.0:1788917000.085191:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788917000.085195:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f800, rc 0) 00000100:00100000:2.0:1788917000.085281:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+25:11396:x1875815113490816:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 612us (861us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788917000.085289:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 147 00000100:00100000:1.0:1788917000.087355:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917000.087457:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113490944 00000100:00100000:3.0:1788917000.087467:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113490944 00000100:00100000:3.0:1788917000.087540:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:3.0:1788917000.087552:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+25:2374:x1875815113490944:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917000.087571:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917000.087602:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e0dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6f1 expref: 25 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.087622:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceec00) 00010000:00010000:3.0:1788917000.087627:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917000.087689:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+24:2374:x1875815113490944:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 140us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917000.087697:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:1.0:1788917000.092008:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917000.092118:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113491072 00000100:00100000:0.0:1788917000.092129:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113491072 00000100:00100000:0.0:1788917000.092222:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:0.0:1788917000.092234:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2374:x1875815113491072:12345-192.168.202.40@tcp:1:lfs.0 00010000:00010000:0.0:1788917000.092282:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cde849b/0x51de7f756a83e100 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.092320:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f23f8dc2/0x51de7f756a83e0b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6dc expref: 6 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.092329:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788917000.092333:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788917000.092338:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cde849b/0x51de7f756a83e100 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.092377:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f23f8dc2/0x51de7f756a83e0b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6dc expref: 6 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.092391:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f23f8dc2/0x51de7f756a83e0b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6dc expref: 6 pid: 8068 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917000.092409:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36ef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1875815140760064:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917000.092526:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3c5f9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788917000.094905:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36ef8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1875815140760064:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788917000.094938:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004cde849b/0x51de7f756a83e100 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917000.096988:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917000.097205:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113491200 00000100:00100000:2.0:1788917000.097217:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113491200 00002000:00100000:2.0:1788917000.097272:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9a6e2d08c000 x1875815113491200/t0(0) o4->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:381/0 lens 504/0 e 0 to 0 dl 1788917011 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788917000.097282:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e2d08c000 with x1875815113491200 ext(0->12) 00010000:00010000:2.0:1788917000.097292:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f23f8dc2/0x51de7f756a83e0b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6dc expref: 7 pid: 8068 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.097310:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f23f8dc2/0x51de7f756a83e0b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6dc expref: 7 pid: 8068 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788917000.097318:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a6e2d08c000 00000100:00100000:2.0:1788917000.097608:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:2.0:1788917000.097620:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2373:x1875815113491200:12345-192.168.202.40@tcp:4:lfs.0 00000100:00100000:2.0:1788917000.098221:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:2373:x1875815113491200:12345-192.168.202.40@tcp:4:lfs.0 Request processed in 601us (1240us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788917000.098236:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00002000:00100000:2.0:1788917000.098245:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9a6e2d08c000 x1875815113491200/t4294967305(0) o4->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:381/0 lens 504/448 e 0 to 0 dl 1788917011 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788917000.098253:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e2d08c000 with x1875815113491200 ext(0->12) 00010000:00010000:2.0:1788917000.098261:0:6597:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f23f8dc2/0x51de7f756a83e0b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6dc expref: 9 pid: 8068 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.098274:0:6597:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f23f8dc2/0x51de7f756a83e0b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6dc expref: 9 pid: 8068 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788917000.098281:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a6e2d08c000 00000100:00100000:1.0:1788917000.101783:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917000.101915:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113491328 00000100:00100000:3.0:1788917000.101926:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113491328 00010000:00010000:3.0:1788917000.101966:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f23f8dc2/0x51de7f756a83e0b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6dc expref: 9 pid: 8068 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917000.102012:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:3.0:1788917000.102022:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:2371:x1875815113491328:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917000.102048:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788917000.102091:0:5779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788917000.102095:0:5779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788916999 00002000:00010000:3.0:1788917000.102097:0:5779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788916999 00002000:00010000:3.0:1788917000.102100:0:5779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788916999 00010000:00010000:3.0:1788917000.102106:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f23f8dc2/0x51de7f756a83e0b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6dc expref: 9 pid: 8068 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.102121:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f23f8dc2/0x51de7f756a83e0b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6dc expref: 9 pid: 8068 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.102352:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f23f8dc2/0x51de7f756a83e0b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6dc expref: 9 pid: 8068 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.102374:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788917000.102379:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788917000.102385:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004cde849b/0x51de7f756a83e100 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.102396:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cde849b/0x51de7f756a83e100 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.102428:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917000.102495:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2371:x1875815113491328:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 474us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917000.102504:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00010000:00010000:0.0:1788917000.102565:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004cde849b/0x51de7f756a83e100 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.102574:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cde849b/0x51de7f756a83e100 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.102609:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cde849b/0x51de7f756a83e100 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.102618:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cde849b/0x51de7f756a83e100 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.102626:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cde849b/0x51de7f756a83e100 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.102633:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3000 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788917000.102637:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cde849b/0x51de7f756a83e100 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.102646:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cde849b/0x51de7f756a83e100 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.102658:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cde849b/0x51de7f756a83e100 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.102664:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cde849b/0x51de7f756a83e100 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917000.102709:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113491072:12345-192.168.202.40@tcp:1:lfs.0 Request processed in 10478us (10713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917000.102717:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:1.0:1788917000.105657:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917000.105738:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113491584 00000100:00100000:3.0:1788917000.105748:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113491584 00000100:00100000:3.0:1788917000.105818:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:3.0:1788917000.105846:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e08cfd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+24:11396:x1875815113491584:12345-192.168.202.40@tcp:35:lfs.0 00000004:00010000:3.0:1788917000.105931:0:5796:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e0f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6f8 expref: 24 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788917000.106424:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788917000.106486:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1788917000.107030:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788917000.107800:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e107 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.107820:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e09e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ce expref: 28 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.107829:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e107 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.107869:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e09e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ce expref: 28 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.107921:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e09e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ce expref: 28 pid: 5793 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917000.107938:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5796:1875815140760192:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788917000.108077:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36fe6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788917000.110917:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917000.110983:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113491712 00000100:00100000:3.0:1788917000.110994:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113491712 00010000:00010000:3.0:1788917000.111041:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e09e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ce expref: 29 pid: 5793 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917000.111084:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:3.0:1788917000.111093:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e408e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:2373:x1875815113491712:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917000.111111:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917000.111119:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e09e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ce expref: 29 pid: 5793 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.111131:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e09e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ce expref: 29 pid: 5793 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.111177:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceec00) 00010000:00010000:3.0:1788917000.111183:0:6606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e107 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.111193:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e107 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.111201:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e107 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.111236:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917000.111292:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e408e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:2373:x1875815113491712:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 199us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917000.111300:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00010000:00010000:2.0:1788917000.120121:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e09e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ce expref: 28 pid: 5793 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917000.120168:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5796:1875815140760192:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788917000.120195:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e107 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.120206:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e107 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.120212:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e107 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788917000.120350:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788917000.120578:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788917000.120695:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5796:1875815140760320:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788917000.121911:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917000.121955:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36fe6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788917000.122025:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140760320 00000100:00100000:3.0:1788917000.122045:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140760320 00000100:00100000:3.0:1788917000.122101:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788917000.122111:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5796:x1875815140760320:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788917000.122241:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5796:x1875815140760320:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 131us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917000.122249:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788917000.122455:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5796:1875815140760320:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788917000.123011:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788917000.123108:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36ef8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5796:1875815140760448:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788917000.123305:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917000.123327:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3c5f90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788917000.123400:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140760448 00000100:00100000:3.0:1788917000.123408:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140760448 00000100:00100000:3.0:1788917000.123464:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788917000.123474:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5796:x1875815140760448:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788917000.123716:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36efad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5796:x1875815140760448:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 244us (411us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788917000.123724:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788917000.123840:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36ef8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5796:1875815140760448:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788917000.123897:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788917000.123936:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e107 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.123948:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e107 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.123956:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e107 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.123962:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168ec00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917000.123967:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e107 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.123974:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e107 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.123992:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceec00) 00010000:00010000:0.0:1788917000.123995:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788917000.124000:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e107 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.124007:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e107 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788917000.124531:0:5796:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788917000.124647:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1788917000.124658:0:5796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 396156510973ns, next at 397156508734ns, rc = 0 00000001:00080000:0.0:1788917000.124665:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788917000.124703:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceec00) 00010000:00010000:0.0:1788917000.124706:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788917000.124714:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e0f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6f8 expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917000.125025:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e08cfd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:11396:x1875815113491584:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 19180us (19379us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788917000.125046:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00000020:00080000:0.0:1788917000.125051:0:5796:0:(tgt_main.c:816:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788917000.127853:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917000.131958:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113491840 00000100:00100000:3.0:1788917000.131975:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113491840 00000100:00100000:3.0:1788917000.132135:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 148 00000100:00100000:3.0:1788917000.132160:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:11396:x1875815113491840:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788917000.132188:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917000.132213:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e10e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f6ff expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.132298:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e10e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ff expref: 32 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.132313:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e10e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ff expref: 32 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.132333:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:3.0:1788917000.132337:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788917000.132340:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f400, rc 0) 00000100:00100000:3.0:1788917000.132404:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+32:11396:x1875815113491840:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 260us (4563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917000.132412:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 148 00000100:00100000:2.0:1788917000.135796:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917000.136256:0:11923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113492096 00000100:00100000:0.0:1788917000.136267:0:11923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113492096 00000100:00100000:0.0:1788917000.136366:0:11923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:0.0:1788917000.136376:0:11923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+32:11396:x1875815113492096:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1788917000.136684:0:11923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+33:11396:x1875815113492096:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 309us (897us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1788917000.136692:0:11923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:1.0:1788917000.220105:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917000.220235:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113492352 00000100:00100000:3.0:1788917000.220245:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113492352 00000100:00100000:3.0:1788917000.220311:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 149 00000100:00100000:3.0:1788917000.220322:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+33:11406:x1875815113492352:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788917000.220352:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917000.220373:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e115 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f706 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917000.220513:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788917000.220646:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e115 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f706 expref: 35 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.220663:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02f3ce00) 00010000:00010000:3.0:1788917000.220667:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788917000.220683:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e115 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f706 expref: 35 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.220701:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18fc00, rc 0) 00000100:00100000:3.0:1788917000.220781:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+34:11406:x1875815113492352:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 460us (688us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788917000.220789:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 149 00000100:00100000:0.0:1788917000.223395:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788917000.223421:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140760576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917000.223513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917000.223672:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140760576 00000100:00100000:2.0:1788917000.223682:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140760576 00000100:00100000:2.0:1788917000.223736:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788917000.223746:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140760576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788917000.223784:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917000.223846:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36ef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140760576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917000.223854:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788917000.223964:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140760576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788917000.225976:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917000.226064:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113492480 00000100:00100000:3.0:1788917000.226073:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113492480 00000100:00100000:3.0:1788917000.226125:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 150 00000100:00100000:3.0:1788917000.226135:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+34:11406:x1875815113492480:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:3.0:1788917000.226248:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e123 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226269:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e123 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226282:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e123 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226299:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e12a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226305:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e12a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226312:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e12a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226428:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e131 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226463:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e131 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226470:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e131 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788917000.226525:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e131 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226539:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e123 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226546:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e123 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226553:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e123 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226559:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18fc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917000.226564:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e123 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226577:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e123 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226591:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:3.0:1788917000.226594:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917000.226599:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e123 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226605:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e123 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226628:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e12a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226634:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e12a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226641:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e12a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226646:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917000.226649:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e12a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226656:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e12a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226665:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e02cee700) 00010000:00010000:3.0:1788917000.226667:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917000.226670:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e12a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226675:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e12a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226692:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e131 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226698:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e131 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226703:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e131 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226714:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917000.226717:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e131 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226724:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e131 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226738:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:3.0:1788917000.226740:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917000.226743:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e131 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.226748:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e131 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917000.227115:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+34:11406:x1875815113492480:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 978us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917000.227125:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 150 00000100:00100000:1.0:1788917000.229804:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917000.229880:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113492736 00000100:00100000:0.0:1788917000.229897:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113492736 00000100:00100000:0.0:1788917000.229943:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:0.0:1788917000.229965:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+34:11406:x1875815113492736:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1788917000.230378:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+35:11406:x1875815113492736:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 412us (580us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788917000.230384:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:1.0:1788917000.261318:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917000.261376:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113492992 00000100:00100000:3.0:1788917000.261386:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113492992 00000100:00100000:3.0:1788917000.261461:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 151 00000100:00100000:3.0:1788917000.261473:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+35:11409:x1875815113492992:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788917000.261501:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917000.261523:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e138 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f70d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.261648:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e13f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.261674:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e13f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.261686:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e13f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.261702:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e146 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.261709:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.261716:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.261848:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83e14d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.261856:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83e14d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.261862:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83e14d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917000.261871:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788917000.261973:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e13f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.261980:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e13f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.261987:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e13f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.261999:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917000.262003:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e13f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.262010:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e13f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.262022:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:3.0:1788917000.262025:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917000.262029:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e13f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.262419:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e13f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.262445:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.262451:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e146 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.262457:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e146 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.262463:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18fc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917000.262466:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e146 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.262472:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e146 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.262492:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e02cee700) 00010000:00010000:3.0:1788917000.262495:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917000.262498:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e146 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.262504:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e146 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.262649:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e138 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f70d expref: 38 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.262666:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83e14d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f70d expref: 37 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.262673:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:2.0:1788917000.262675:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788917000.262678:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18ee00, rc 0) 00000100:00100000:2.0:1788917000.262755:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+37:11409:x1875815113492992:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1284us (1449us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788917000.262764:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 151 00000100:00100000:2.0:1788917000.265461:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917000.265553:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113493120 00000100:00100000:3.0:1788917000.265565:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113493120 00000100:00100000:3.0:1788917000.265655:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 152 00000100:00100000:3.0:1788917000.265666:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+37:11409:x1875815113493120:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:3.0:1788917000.265737:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e15b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.265756:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e15b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.265767:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e15b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.265795:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e15b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.265802:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e15b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.265810:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e15b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.265816:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18ea00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917000.265835:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e15b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.265843:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e15b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.265856:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:3.0:1788917000.265859:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788917000.265864:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e15b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.265869:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e15b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917000.265966:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+37:11409:x1875815113493120:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 302us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917000.265975:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 152 00000100:00100000:1.0:1788917000.268558:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917000.268649:0:11923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113493376 00000100:00100000:0.0:1788917000.268659:0:11923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113493376 00000100:00100000:0.0:1788917000.268742:0:11923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:0.0:1788917000.268753:0:11923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+37:11409:x1875815113493376:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1788917000.268988:0:11923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+38:11409:x1875815113493376:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 236us (440us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788917000.268996:0:11923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:1.0:1788917000.492286:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917000.494469:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113493632 00000100:00100000:2.0:1788917000.494483:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113493632 00000100:00100000:2.0:1788917000.494569:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 153 00000100:00100000:2.0:1788917000.494581:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+38:11440:x1875815113493632:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:2.0:1788917000.494611:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917000.494634:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e162 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f714 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.494740:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e169 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.494754:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.494767:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917000.494793:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788917000.494929:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e162 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f714 expref: 41 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.494956:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e169 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f714 expref: 40 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.494965:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:2.0:1788917000.494968:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788917000.494972:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168ec00, rc 0) 00000100:00100000:2.0:1788917000.495066:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+40:11440:x1875815113493632:12345-192.168.202.40@tcp:101:cat.0 Request processed in 487us (2790us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788917000.495074:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 153 00000100:00100000:1.0:1788917000.498650:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917000.498741:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113493760 00000100:00100000:2.0:1788917000.498752:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113493760 00000100:00100000:2.0:1788917000.498822:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:2.0:1788917000.498832:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+40:2371:x1875815113493760:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788917000.498850:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917000.498876:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e169 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f714 expref: 40 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.498896:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:2.0:1788917000.498901:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788917000.498964:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+39:2371:x1875815113493760:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 133us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917000.498972:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:3.0:1788917000.499810:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917000.500788:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113494016 00000100:00100000:1.0:1788917000.500796:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113494016 00000100:00100000:1.0:1788917000.500870:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:1.0:1788917000.500877:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+39:11440:x1875815113494016:12345-192.168.202.40@tcp:35:cat.0 00000100:00100000:1.0:1788917000.501217:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+40:11440:x1875815113494016:12345-192.168.202.40@tcp:35:cat.0 Request processed in 339us (1407us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788917000.501225:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:1.0:1788917000.549096:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917000.549240:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113494272 00000100:00100000:2.0:1788917000.549251:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113494272 00000100:00100000:2.0:1788917000.549306:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 154 00000100:00100000:2.0:1788917000.549317:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+40:11446:x1875815113494272:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:2.0:1788917000.549343:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917000.549346:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788917000.549376:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e0cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ea expref: 40 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.549399:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:2.0:1788917000.549404:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788917000.549417:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e177 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f71b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.549544:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e17e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.549555:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83e14d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f70d expref: 40 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.549561:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e17e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.549588:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83e14d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f70d expref: 40 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.549597:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83e14d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f70d expref: 40 pid: 5793 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917000.549617:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1875815140760704:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788917000.549726:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36fe6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788917000.552193:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917000.552263:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113494400 00000100:00100000:3.0:1788917000.552271:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113494400 00010000:00010000:3.0:1788917000.552306:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83e14d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f70d expref: 41 pid: 5793 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917000.552349:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:3.0:1788917000.552358:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+41:2373:x1875815113494400:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917000.552373:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917000.552379:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83e14d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f70d expref: 41 pid: 5793 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.552390:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83e14d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f70d expref: 41 pid: 5793 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.552421:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:3.0:1788917000.552427:0:6606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e17e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.552447:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e17e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.552456:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e17e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.552477:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917000.552527:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+41:2373:x1875815113494400:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 168us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917000.552534:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 65 00010000:00010000:2.0:1788917000.553396:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83e14d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f70d expref: 40 pid: 5793 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917000.553416:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1875815140760704:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788917000.553447:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e17e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.553457:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e17e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.553463:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e17e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917000.553481:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788917000.553638:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e177 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f71b expref: 41 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.553654:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e17e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f71b expref: 40 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.553663:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:2.0:1788917000.553665:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788917000.553668:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f800, rc 0) 00000100:00100000:2.0:1788917000.553759:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+40:11446:x1875815113494272:12345-192.168.202.40@tcp:101:dd.0 Request processed in 4444us (4672us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788917000.553780:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 154 00000100:00100000:1.0:1788917000.558414:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917000.558490:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113494656 00000100:00100000:2.0:1788917000.558502:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113494656 00000100:00100000:2.0:1788917000.558564:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 155 00000100:00100000:2.0:1788917000.558843:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+40:11446:x1875815113494656:12345-192.168.202.40@tcp:36:dd.0 00010000:00010000:2.0:1788917000.559349:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e18c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.559369:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e18c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.559382:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e18c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788917000.559491:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788917000.559519:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a5ce258e reply state 00000000340a3453 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e18c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917000.559528:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788917000.559629:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+43:11446:x1875815113494656:12345-192.168.202.40@tcp:36:dd.0 Request processed in 1053us (1221us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788917000.559637:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 155 00000020:00080000:2.0:1788917000.559642:0:5794:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788917000.567221:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e18c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.567241:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e18c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.567249:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e18c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.567273:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917000.567278:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e18c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.567286:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e18c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.567304:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:2.0:1788917000.567307:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917000.567312:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e18c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.567318:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e18c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917000.735661:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140760832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788917000.735762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917000.735916:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140760832 00000100:00100000:3.0:1788917000.735930:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140760832 00000100:00100000:3.0:1788917000.736017:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788917000.736031:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875815140760832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788917000.736066:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788917000.736501:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36ef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875815140760832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 472us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917000.736510:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788917000.736606:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140760832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917000.744361:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917000.744457:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113494784 00000100:00100000:3.0:1788917000.744471:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113494784 00000100:00100000:3.0:1788917000.744541:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 156 00000100:00100000:3.0:1788917000.744552:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+42:11460:x1875815113494784:12345-192.168.202.40@tcp:101:stat.0 00010000:00010000:3.0:1788917000.744578:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917000.744616:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e193 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f722 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.744696:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e19a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.744712:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e19a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.744722:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e19a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.744734:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e1a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.744913:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.744920:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.745193:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e1a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.745201:0:8069:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e17e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f71b expref: 43 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.745207:0:8069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e1a8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.745238:0:8069:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e17e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f71b expref: 43 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917000.745257:0:8069:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e17e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f71b expref: 43 pid: 5792 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917000.745269:0:8069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37209500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140760960:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788917000.745341:0:8069:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e02b9bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788917000.748230:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917000.748488:0:8069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37209500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140760960:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788917000.748524:0:8069:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e1a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917000.749065:0:11923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113495040 00000100:00100000:0.0:1788917000.749073:0:11923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113495040 00000100:00100000:0.0:1788917000.749163:0:11923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:0.0:1788917000.749174:0:11923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+44:5590:x1875815113495040:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788917000.749566:0:11923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+45:5590:x1875815113495040:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 393us (1347us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788917000.749576:0:11923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:3.0:1788917000.751846:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917000.751910:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113495168 00000100:00100000:2.0:1788917000.751921:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113495168 00010000:00010000:2.0:1788917000.751962:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e17e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f71b expref: 45 pid: 5792 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917000.752057:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:2.0:1788917000.752068:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3720b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+45:2374:x1875815113495168:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788917000.752090:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917000.752097:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e17e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f71b expref: 45 pid: 5792 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.752123:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e17e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f71b expref: 45 pid: 5792 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.752171:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e17e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f71b expref: 45 pid: 5792 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.752189:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:2.0:1788917000.752194:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e1a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.752203:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.752211:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e1a8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.752248:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788917000.752303:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3720b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+44:2374:x1875815113495168:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 237us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917000.752310:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 66 00010000:00010000:0.0:1788917000.752373:0:8069:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752382:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917000.752447:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788917000.752460:0:8069:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788917000.752485:0:8069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752498:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752506:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e19a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752512:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e19a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752518:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e19a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752524:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18fc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917000.752529:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e19a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752536:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e19a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752545:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:0.0:1788917000.752548:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917000.752552:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e19a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752558:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e19a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752579:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e1a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752585:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e1a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752592:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e1a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752596:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917000.752599:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e1a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752605:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e1a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752611:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e02cee700) 00010000:00010000:0.0:1788917000.752614:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917000.752616:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e1a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752622:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e1a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752654:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e193 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f722 expref: 44 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752667:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e1a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f722 expref: 43 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.752683:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:0.0:1788917000.752685:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788917000.752688:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e000, rc 0) 00000100:00100000:0.0:1788917000.752712:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+43:11460:x1875815113494784:12345-192.168.202.40@tcp:101:stat.0 Request processed in 8163us (8367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917000.752718:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 156 00000100:00100000:1.0:1788917000.793837:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917000.794121:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113495424 00000100:00100000:2.0:1788917000.794132:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113495424 00000100:00100000:2.0:1788917000.794378:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 157 00000100:00100000:2.0:1788917000.794391:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+43:11466:x1875815113495424:12345-192.168.202.40@tcp:36:truncate.0 00010000:00010000:2.0:1788917000.794508:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917000.794539:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e1a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f722 expref: 43 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.794573:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:2.0:1788917000.794578:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788917000.794811:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1af lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.794826:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.794836:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788917000.794889:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788917000.794914:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002b354766 reply state 00000000331525bb transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917000.794924:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788917000.795040:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+45:11466:x1875815113495424:12345-192.168.202.40@tcp:36:truncate.0 Request processed in 651us (1216us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788917000.795047:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 157 00000020:00080000:2.0:1788917000.795057:0:5793:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788917000.802748:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.802769:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.802777:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.802784:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917000.802812:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.802822:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.802840:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:2.0:1788917000.802844:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917000.802848:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1af lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.802853:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1af lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917000.914561:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917000.914808:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113495552 00000100:00100000:2.0:1788917000.914820:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113495552 00000100:00100000:2.0:1788917000.914900:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 158 00000100:00100000:2.0:1788917000.914910:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+44:11480:x1875815113495552:12345-192.168.202.40@tcp:101:stat.0 00010000:00010000:2.0:1788917000.914936:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917000.914957:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f729 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915189:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915207:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915220:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915236:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e1c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915258:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915265:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915369:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e1cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915377:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e1cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915384:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e1cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917000.915420:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788917000.915424:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788917000.915473:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e1cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915485:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e1cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915493:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915499:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915506:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915521:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917000.915526:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915533:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915545:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:2.0:1788917000.915548:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917000.915552:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915558:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915572:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915577:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e1c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915583:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915587:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168ec00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917000.915590:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915596:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e1c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915612:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e02f3c700) 00010000:00010000:2.0:1788917000.915615:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917000.915618:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e1c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915623:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e1c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915659:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f729 expref: 46 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915673:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e1cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f729 expref: 45 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917000.915680:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:2.0:1788917000.915682:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788917000.915685:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168ee00, rc 0) 00000100:00100000:2.0:1788917000.915863:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+45:11480:x1875815113495552:12345-192.168.202.40@tcp:101:stat.0 Request processed in 953us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917000.915872:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 158 00000100:00100000:1.0:1788917000.969935:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917000.970076:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113495808 00000100:00100000:0.0:1788917000.970087:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113495808 00000100:00100000:0.0:1788917000.970173:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 159 00000100:00100000:0.0:1788917000.970184:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+45:11490:x1875815113495808:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1788917000.970205:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917000.970226:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e1d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f730 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917000.970350:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1788917000.970479:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e1d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f730 expref: 47 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.970494:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02f3ce00) 00010000:00010000:0.0:1788917000.970497:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788917000.970502:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e1d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f730 expref: 47 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917000.970519:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3000, rc 0) 00000100:00100000:0.0:1788917000.970813:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+46:11490:x1875815113495808:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 629us (885us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1788917000.970839:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 159 00000100:00100000:3.0:1788917000.972814:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917000.973269:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113496064 00000100:00100000:1.0:1788917000.973277:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113496064 00000100:00100000:1.0:1788917000.973355:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:1.0:1788917000.973364:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e08cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+46:11490:x1875815113496064:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1788917000.973587:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e08cfdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+47:11490:x1875815113496064:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 224us (779us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788917000.973593:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00010000:00010000:3.0:1788917000.991658:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917001.013557:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917001.013702:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113496320 00000100:00100000:2.0:1788917001.013712:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113496320 00000100:00100000:2.0:1788917001.013814:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 160 00000100:00100000:2.0:1788917001.013825:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+47:11496:x1875815113496320:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1788917001.013856:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917001.013879:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e1e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f737 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.014034:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.014215:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e1cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f729 expref: 48 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.014226:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1e7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.014261:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e1cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f729 expref: 48 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.014275:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e1cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f729 expref: 48 pid: 5792 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917001.014291:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd30380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1875815140761088:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788917001.014383:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36fe6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788917001.016350:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd30380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1875815140761088:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788917001.016377:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917001.020340:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917001.020979:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113496448 00000100:00100000:3.0:1788917001.020991:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113496448 00010000:00010000:3.0:1788917001.021051:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e1cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f729 expref: 49 pid: 5792 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917001.021140:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:3.0:1788917001.021173:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+49:2373:x1875815113496448:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917001.021189:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917001.021198:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e1cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f729 expref: 49 pid: 5792 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.021211:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e1cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f729 expref: 49 pid: 5792 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.021251:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e1cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f729 expref: 49 pid: 5792 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.021269:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:3.0:1788917001.021274:0:6606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.021283:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.021291:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1e7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.021321:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788917001.021364:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.021376:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917001.021387:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+48:2373:x1875815113496448:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 216us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917001.021395:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00000004:00200000:2.0:1788917001.021397:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788917001.021576:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e1e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f737 expref: 49 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.021594:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f737 expref: 48 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.021614:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:2.0:1788917001.021617:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788917001.021620:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f200, rc 0) 00000100:00100000:2.0:1788917001.021660:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+48:11496:x1875815113496320:12345-192.168.202.40@tcp:101:bash.0 Request processed in 7837us (8117us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788917001.021667:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 160 00000100:00100000:1.0:1788917001.025054:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917001.026584:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113496704 00000100:00100000:2.0:1788917001.026598:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113496704 00000100:00100000:2.0:1788917001.026679:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 161 00000100:00100000:2.0:1788917001.026689:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+48:11496:x1875815113496704:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:2.0:1788917001.027182:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.027202:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.027215:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788917001.027271:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788917001.027299:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002a3cb316 reply state 00000000e566c6c6 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917001.027309:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788917001.027456:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+51:11496:x1875815113496704:12345-192.168.202.40@tcp:36:bash.0 Request processed in 767us (2412us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788917001.027465:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 161 00000020:00080000:2.0:1788917001.027484:0:5793:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788917001.032451:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.032472:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.032547:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.032556:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917001.032563:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.032572:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.032590:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:2.0:1788917001.032594:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917001.032599:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.032606:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e1f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917001.039539:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917001.039850:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113496832 00000100:00100000:2.0:1788917001.039861:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113496832 00000100:00100000:2.0:1788917001.039927:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 162 00000100:00100000:2.0:1788917001.039939:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+50:11496:x1875815113496832:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1788917001.039967:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917001.039991:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e1fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f73e expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.040115:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83e203 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.040132:0:8069:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f737 expref: 51 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.040142:0:8069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83e203 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.040212:0:8069:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f737 expref: 51 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.040228:0:8069:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f737 expref: 51 pid: 5792 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917001.040244:0:8069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140761216:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788917001.040340:0:8069:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36fe6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788917001.043685:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917001.043733:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113496960 00000100:00100000:3.0:1788917001.043742:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113496960 00010000:00010000:3.0:1788917001.043792:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1e7 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f737 expref: 52 pid: 5792 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917001.043889:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:3.0:1788917001.043902:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+52:2373:x1875815113496960:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917001.043918:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917001.043926:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1e7 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f737 expref: 52 pid: 5792 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917001.043933:0:8069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140761216:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788917001.043955:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f737 expref: 52 pid: 5792 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.043968:0:8069:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83e203 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.043981:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e1e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f737 expref: 52 pid: 5792 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.044000:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:3.0:1788917001.044005:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83e203 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.044013:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83e203 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.044021:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83e203 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.044048:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917001.044114:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+51:2373:x1875815113496960:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 215us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917001.044123:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00010000:00010000:2.0:1788917001.044183:0:8069:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83e203 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.044192:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83e203 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917001.044243:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788917001.044255:0:8069:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788917001.044280:0:8069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83e203 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.044312:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e1fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f73e expref: 51 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.044328:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83e203 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f73e expref: 50 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.044336:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:2.0:1788917001.044339:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788917001.044341:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168e800, rc 0) 00000100:00100000:2.0:1788917001.044829:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+50:11496:x1875815113496832:12345-192.168.202.40@tcp:101:bash.0 Request processed in 4890us (5301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917001.044837:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 162 00000100:00100000:1.0:1788917001.051269:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917001.051381:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113497216 00000100:00100000:2.0:1788917001.051393:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113497216 00000100:00100000:2.0:1788917001.051527:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:2.0:1788917001.051539:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+50:11496:x1875815113497216:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:2.0:1788917001.051833:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+51:11496:x1875815113497216:12345-192.168.202.40@tcp:35:bash.0 Request processed in 295us (574us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788917001.051841:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:0.0:1788917001.119724:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917001.119875:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113497472 00000100:00100000:1.0:1788917001.119896:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113497472 00000100:00100000:1.0:1788917001.119954:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 163 00000100:00100000:1.0:1788917001.119964:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+51:11506:x1875815113497472:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1788917001.119988:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788917001.120009:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83e20a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f745 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788917001.120224:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1788917001.120367:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83e20a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f745 expref: 53 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.120383:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02f3ce00) 00010000:00010000:1.0:1788917001.120386:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788917001.120392:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83e20a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f745 expref: 53 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.120408:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeaa400, rc 0) 00000100:00100000:1.0:1788917001.120498:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36ef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+52:11506:x1875815113497472:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 535us (785us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1788917001.120506:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 163 00000100:00100000:1.0:1788917001.123732:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917001.123880:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113497600 00000100:00100000:3.0:1788917001.123896:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113497600 00000100:00100000:3.0:1788917001.123956:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 164 00000100:00100000:3.0:1788917001.123966:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+52:11506:x1875815113497600:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:3.0:1788917001.124059:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e218 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124077:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e218 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124104:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e218 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124121:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e21f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124129:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e21f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124136:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e21f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124275:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e226 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124285:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e226 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124292:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e226 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788917001.124335:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e226 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124348:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e218 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124356:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e218 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124363:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e218 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124383:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917001.124387:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e218 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124394:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e218 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124408:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:3.0:1788917001.124411:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917001.124417:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e218 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124423:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e218 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124452:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e21f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124459:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e21f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124464:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e21f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124469:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917001.124472:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e21f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124478:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e21f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124496:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e02ceeb00) 00010000:00010000:3.0:1788917001.124498:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917001.124501:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e21f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124507:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e21f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124523:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e226 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124529:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e226 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124535:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e226 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124540:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917001.124542:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e226 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124548:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e226 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124555:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:3.0:1788917001.124557:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917001.124560:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e226 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.124566:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e226 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917001.124887:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+52:11506:x1875815113497600:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 920us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917001.124895:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 164 00000100:00100000:1.0:1788917001.133137:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917001.134377:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113497856 00000100:00100000:0.0:1788917001.134391:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113497856 00000100:00100000:0.0:1788917001.136566:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:0.0:1788917001.136589:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+52:11506:x1875815113497856:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1788917001.136873:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+53:11506:x1875815113497856:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 295us (3745us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788917001.136882:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:0.0:1788917001.168136:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917001.168311:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113498112 00000100:00100000:1.0:1788917001.168322:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113498112 00000100:00100000:1.0:1788917001.168382:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 165 00000100:00100000:1.0:1788917001.168393:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+53:11509:x1875815113498112:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1788917001.168420:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788917001.168453:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83e22d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f74c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168539:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e234 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168571:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e234 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168583:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e234 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168598:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83e23b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168604:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83e23b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168610:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83e23b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168731:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83e242 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168740:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83e242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168760:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83e242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788917001.168771:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788917001.168869:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e234 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168877:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e234 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168884:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e234 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168897:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaae00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917001.168901:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e234 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168909:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e234 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168921:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:1.0:1788917001.168936:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788917001.168941:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e234 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168946:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e234 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168959:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83e23b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168964:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83e23b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168970:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83e23b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168974:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaaa00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917001.168977:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83e23b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168982:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83e23b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.168998:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e1959e900) 00010000:00010000:1.0:1788917001.169001:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788917001.169003:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83e23b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.169008:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaaa00/0x51de7f756a83e23b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.169246:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83e22d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f74c expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.169262:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83e242 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f74c expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917001.169270:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:1.0:1788917001.169272:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788917001.169275:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeab200, rc 0) 00000100:00100000:1.0:1788917001.169340:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36efbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:11509:x1875815113498112:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 948us (1213us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788917001.169347:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 165 00000100:00100000:3.0:1788917001.172133:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917001.172201:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917001.172236:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113498368 00000100:00100000:0.0:1788917001.172256:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113498368 00000100:00100000:0.0:1788917001.172319:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:0.0:1788917001.172327:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37208000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:2373:x1875815113498368:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788917001.172342:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917001.172365:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83e242 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f74c expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917001.172383:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:0.0:1788917001.172387:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788917001.172449:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37208000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+54:2373:x1875815113498368:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 122us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917001.172457:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:2.0:1788917001.172475:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113498240 00000100:00100000:2.0:1788917001.172479:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113498240 00000100:00100000:2.0:1788917001.172519:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 166 00000100:00100000:2.0:1788917001.172527:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+54:11509:x1875815113498240:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:2.0:1788917001.172584:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e250 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.172610:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e250 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.172620:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e250 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.172647:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e250 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.172655:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e250 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.172661:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e250 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.172668:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917001.172671:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e250 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.172678:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e250 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.172685:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:2.0:1788917001.172688:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788917001.172691:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e250 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.172696:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e250 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917001.172730:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+54:11509:x1875815113498240:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 204us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917001.172743:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 166 00000100:00100000:2.0:1788917001.194590:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917001.194712:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113498624 00000100:00100000:3.0:1788917001.194723:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113498624 00000100:00100000:3.0:1788917001.194784:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:3.0:1788917001.194795:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+54:11509:x1875815113498624:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1788917001.195053:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:11509:x1875815113498624:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 260us (473us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788917001.195061:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:1.0:1788917001.323939:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917001.329286:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113498880 00000100:00100000:2.0:1788917001.329304:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113498880 00000100:00100000:2.0:1788917001.329390:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 167 00000100:00100000:2.0:1788917001.329401:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:11527:x1875815113498880:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:2.0:1788917001.329443:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917001.329470:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e257 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f753 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.329591:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e25e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.329607:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e25e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.329619:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e25e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917001.329632:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788917001.329781:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e257 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f753 expref: 58 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.329800:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e25e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f753 expref: 57 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.329809:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:2.0:1788917001.329812:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788917001.329829:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168ec00, rc 0) 00000100:00100000:2.0:1788917001.329918:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+57:11527:x1875815113498880:12345-192.168.202.40@tcp:101:cat.0 Request processed in 518us (5990us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788917001.329927:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 167 00000100:00100000:3.0:1788917001.349561:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917001.352393:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113499008 00000100:00100000:0.0:1788917001.352409:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113499008 00000100:00100000:0.0:1788917001.352515:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 168 00000100:00100000:0.0:1788917001.352526:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+57:11528:x1875815113499008:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1788917001.352554:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917001.352582:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e26c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f75a expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917001.352663:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e273 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917001.352678:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917001.352690:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917001.352906:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1788917001.352911:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788917001.352937:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917001.352969:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e26c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f75a expref: 59 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917001.352990:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e273 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f75a expref: 58 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917001.352999:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:0.0:1788917001.353002:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788917001.353005:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3a00, rc 0) 00000100:00100000:0.0:1788917001.353083:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+58:11528:x1875815113499008:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 558us (3539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917001.353097:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 168 00000100:00100000:1.0:1788917001.356584:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917001.357128:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113499392 00000100:00100000:0.0:1788917001.357139:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113499392 00000100:00100000:0.0:1788917001.357876:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:0.0:1788917001.357947:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+58:11528:x1875815113499392:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1788917001.358533:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+59:11528:x1875815113499392:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 589us (1956us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788917001.358543:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:3.0:1788917001.360684:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917001.360864:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113499520 00000100:00100000:2.0:1788917001.360875:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113499520 00000100:00100000:2.0:1788917001.361137:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:2.0:1788917001.361175:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e408e3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+59:11528:x1875815113499520:12345-192.168.202.40@tcp:103:lfs.0 00010000:00010000:2.0:1788917001.361193:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788917001.361221:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83e203 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f73e expref: 59 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.361246:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83e25e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f753 expref: 58 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.361258:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e10e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6ff expref: 57 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.361271:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:2.0:1788917001.361282:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788917001.361336:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e408e3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+56:11528:x1875815113499520:12345-192.168.202.40@tcp:103:lfs.0 Request processed in 190us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917001.361343:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:0.0:1788917001.363092:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917001.363175:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113499648 00000100:00100000:3.0:1788917001.363182:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113499648 00000100:00100000:3.0:1788917001.363227:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 169 00000100:00100000:3.0:1788917001.363236:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+56:11528:x1875815113499648:12345-192.168.202.40@tcp:58:lfs.0 00010000:00010000:3.0:1788917001.363337:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e27a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.363353:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e27a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917001.363364:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e27a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788917001.363598:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788917001.363685:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36efa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+56:11528:x1875815113499648:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 449us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917001.363693:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 169 00000100:00100000:0.0:1788917001.387356:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917001.387464:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113499776 00000100:00100000:2.0:1788917001.387475:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113499776 00000100:00100000:2.0:1788917001.387565:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 170 00000100:00100000:2.0:1788917001.387576:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+56:11530:x1875815113499776:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788917001.387627:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917001.387653:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e281 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f761 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.387724:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e288 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.387751:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e288 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.387762:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e288 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.387778:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e28f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.387785:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e28f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.387791:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e28f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.387912:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e296 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.387922:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.387929:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917001.387965:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788917001.387977:0:8069:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788917001.388001:0:8069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.388013:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.388022:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e288 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.388028:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e288 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.388036:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e288 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.388042:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917001.388047:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e288 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.388055:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e288 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.388067:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:2.0:1788917001.388070:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917001.388073:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e288 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.388080:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83e288 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.388094:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e28f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.388109:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e28f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.388115:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e28f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.388120:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168ee00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917001.388123:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e28f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.388129:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e28f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.388135:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e02f3c700) 00010000:00010000:2.0:1788917001.388138:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917001.388140:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e28f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.388181:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83e28f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.388213:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83e281 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f761 expref: 58 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.388225:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e296 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f761 expref: 57 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917001.388232:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceeb00) 00010000:00010000:2.0:1788917001.388235:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788917001.388241:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031600, rc 0) 00000100:00100000:2.0:1788917001.388294:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36ef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+57:11530:x1875815113499776:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 720us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917001.388301:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 170 00000100:00100000:0.0:1788917001.611119:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917001.611340:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113499904 00000100:00100000:3.0:1788917001.611352:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113499904 00000100:00100000:3.0:1788917001.611405:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 290 00000100:00100000:3.0:1788917001.611415:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:2374:x1875815113499904:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917001.611519:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f367f55b-9b55-442e-a009-d3d404e176a2+13:2374:x1875815113499904:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 104us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917001.611527:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 290 00000100:00100000:1.0:1788917001.611837:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917001.612129:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113500032 00000100:00100000:3.0:1788917001.612134:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113500032 00000100:00100000:3.0:1788917001.612212:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:3.0:1788917001.612219:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113500032:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917001.612263:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113500032:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 45us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917001.612269:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00080000:1.0:1788917001.612336:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917001.617495:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917001.617754:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113500160 00000100:00100000:3.0:1788917001.617764:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113500160 00000100:00100000:3.0:1788917001.617844:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00100000:3.0:1788917001.617856:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2374:x1875815113500160:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917001.617943:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2374:x1875815113500160:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 90us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917001.617964:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00080000:1.0:1788917001.618276:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788917001.618434:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917001.618504:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113500288 00000100:00100000:1.0:1788917001.618509:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113500288 00000100:00100000:1.0:1788917001.618567:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00100000:1.0:1788917001.618574:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2374:x1875815113500288:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917001.618619:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2374:x1875815113500288:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 45us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917001.618626:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00080000:3.0:1788917001.619958:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788917002.015330:0:11537:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788917002.015340:0:11537:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917002.015393:0:11537:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1788917002.015402:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788917002.015549:0:11537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36efb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1875815140761344:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788917002.015646:0:11537:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3c5f9780 going to sleep for 11 seconds 00010000:00010000:0.0:1788917002.015947:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917002.025279:0:11537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36efb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1875815140761344:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788917002.025648:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917002.025676:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113500416 00000100:00100000:0.0:1788917002.025684:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113500416 00000100:00100000:0.0:1788917002.025749:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 171 00000100:00100000:0.0:1788917002.025759:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+57:11541:x1875815113500416:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788917002.025794:0:5792:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788917002.025922:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36efb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+57:11541:x1875815113500416:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 162us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917002.025930:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 171 00000100:00080000:0.0:1788917002.025953:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788917002.035755:0:12361:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788917002.035765:0:12361:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917002.035816:0:12361:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788917002.035824:0:12361:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788917002.036059:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917002.036136:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113500544 00000100:00100000:0.0:1788917002.036171:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113500544 00000100:00100000:0.0:1788917002.036222:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 172 00000100:00100000:0.0:1788917002.036232:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+57:11541:x1875815113500544:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788917002.036307:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e29d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036323:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e29d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036335:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e29d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036351:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2a4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036358:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036364:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036389:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036397:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036414:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917002.036462:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788917002.036466:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788917002.036478:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036489:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e29d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036495:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e29d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036502:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e29d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036508:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917002.036513:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e29d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036521:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e29d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036533:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:0.0:1788917002.036536:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917002.036541:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e29d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036548:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e29d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036568:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036574:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2a4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036580:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036585:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917002.036587:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036593:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2a4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036601:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9a6e03d86100) 00010000:00010000:0.0:1788917002.036603:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917002.036606:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2a4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036611:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2a4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036624:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036630:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036635:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036646:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917002.036650:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036656:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036663:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceeb00) 00010000:00010000:0.0:1788917002.036665:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917002.036668:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.036673:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917002.036744:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+57:11541:x1875815113500544:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 Request processed in 513us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917002.036752:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 172 00000100:00100000:1.0:1788917002.044229:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917002.044265:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113500800 00000100:00100000:1.0:1788917002.044275:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113500800 00000100:00100000:1.0:1788917002.044326:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 173 00000100:00100000:1.0:1788917002.044337:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+57:11541:x1875815113500800:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788917002.044359:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788917002.044381:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e2b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f768 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917002.044504:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e2b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917002.044519:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917002.044533:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788917002.044545:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788917002.044644:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917002.044661:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e2b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917002.044668:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e2b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917002.044674:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaae00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917002.044678:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e2b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917002.044685:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e2b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917002.044697:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceeb00) 00010000:00010000:1.0:1788917002.044700:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788917002.044705:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e2b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917002.044712:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e2b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917002.044752:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e2b2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f768 expref: 59 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917002.044763:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:1.0:1788917002.044765:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788917002.044769:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e2b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f768 expref: 59 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917002.044777:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeaac00, rc 0) 00000100:00100000:1.0:1788917002.044843:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+58:11541:x1875815113500800:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 507us (624us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1788917002.044851:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 173 00000100:00100000:2.0:1788917002.055239:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917002.055448:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113500928 00000100:00100000:1.0:1788917002.055458:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113500928 00000100:00100000:1.0:1788917002.055520:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 174 00000100:00100000:1.0:1788917002.055531:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+58:11541:x1875815113500928:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788917002.055580:0:5793:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788917002.055698:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+58:11541:x1875815113500928:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 168us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917002.055706:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 174 00000100:00100000:2.0:1788917002.058948:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917002.058983:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113501184 00000100:00100000:2.0:1788917002.058992:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113501184 00000100:00100000:2.0:1788917002.059038:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 175 00000100:00100000:2.0:1788917002.059046:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+58:11541:x1875815113501184:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788917002.059065:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917002.059068:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788917002.059093:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e273 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f75a expref: 58 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.059109:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:2.0:1788917002.059113:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788917002.059124:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e2c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f76f expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788917002.059566:0:5792:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788917002.059772:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e2ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.059785:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e2ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.059795:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e2ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.059867:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e2c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f76f expref: 60 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.059884:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e2ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f76f expref: 59 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.059891:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6e02f3c700) 00010000:00010000:2.0:1788917002.059894:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788917002.059897:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00030e00, rc 0) 00000100:00100000:2.0:1788917002.059961:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+59:11541:x1875815113501184:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 915us (1018us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788917002.059969:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 175 00000100:00100000:3.0:1788917002.064380:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917002.067828:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113501440 00000100:00100000:0.0:1788917002.067844:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113501440 00000100:00100000:0.0:1788917002.067913:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 176 00000100:00100000:0.0:1788917002.067925:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+59:11541:x1875815113501440:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788917002.067988:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917002.068019:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e2ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f76f expref: 59 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068038:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6e02f3c700) 00010000:00010000:0.0:1788917002.068049:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788917002.068082:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068096:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068106:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068120:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf7ba5b64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068127:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7ba5b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068133:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7ba5b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068239:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068247:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068253:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068260:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917002.068264:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068271:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068290:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:0.0:1788917002.068292:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917002.068296:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068301:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e2dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068310:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7ba5b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068315:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7ba5b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068320:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7ba5b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068324:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2c00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917002.068326:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7ba5b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068331:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7ba5b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068337:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf7ba5b64 (ffff9a6e03d86100) 00010000:00010000:0.0:1788917002.068339:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917002.068341:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf7ba5b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.068345:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2c00/0x51de7f756a83e2e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf7ba5b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917002.068450:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+58:11541:x1875815113501440:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 527us (4078us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788917002.068457:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 176 00000100:00100000:0.0:1788917002.085104:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917002.085219:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113501568 00000100:00100000:2.0:1788917002.085230:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113501568 00000100:00100000:2.0:1788917002.085287:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 177 00000100:00100000:2.0:1788917002.085297:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+58:11541:x1875815113501568:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788917002.085320:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917002.085342:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e2ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f776 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.085873:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83e2f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.085888:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83e2f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.085901:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83e2f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.086016:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e2ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f776 expref: 60 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.086035:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83e2f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f776 expref: 59 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.086043:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6e02f3c600) 00010000:00010000:2.0:1788917002.086046:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788917002.086049:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031c00, rc 0) 00000100:00100000:2.0:1788917002.086188:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36ef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+59:11541:x1875815113501568:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 892us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917002.086196:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 177 00000100:00100000:1.0:1788917002.095746:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917002.096031:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113501824 00000100:00100000:3.0:1788917002.096042:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113501824 00000100:00100000:3.0:1788917002.096106:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 178 00000100:00100000:3.0:1788917002.096117:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+59:11541:x1875815113501824:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788917002.096230:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e2f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.096249:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e2f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.096260:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e2f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788917002.096566:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788917002.096578:0:5793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 398128430914ns, next at 399128428364ns, rc = 0 00000004:00010000:3.0:1788917002.096677:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec5f467a reply state 000000004280a0f0 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e2f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917002.096688:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788917002.096792:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+61:11541:x1875815113501824:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 677us (1061us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788917002.096915:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 178 00010000:00010000:0.0:1788917002.100497:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e2f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.100514:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e2f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.100522:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e2f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.100529:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917002.100535:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e2f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.100544:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e2f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.100578:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6e02f3c600) 00010000:00010000:0.0:1788917002.100581:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788917002.100586:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e2f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.100593:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e2f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917002.103802:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917002.105765:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113501952 00000100:00100000:3.0:1788917002.105783:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113501952 00000100:00100000:3.0:1788917002.105879:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 179 00000100:00100000:3.0:1788917002.105892:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+60:11541:x1875815113501952:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788917002.105921:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917002.105946:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e2ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f77d expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.106012:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e2ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f77d expref: 61 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.106026:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e2ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f77d expref: 61 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.106047:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6e02f3c600) 00010000:00010000:3.0:1788917002.106050:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788917002.106054:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f200, rc 0) 00000100:00100000:3.0:1788917002.106134:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+61:11541:x1875815113501952:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 245us (2342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917002.106141:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 179 00000100:00100000:3.0:1788917002.111708:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917002.112538:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113502080 00000100:00100000:1.0:1788917002.112553:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113502080 00000100:00100000:1.0:1788917002.112613:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:1.0:1788917002.112625:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3720b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2374:x1875815113502080:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788917002.113074:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3720b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113502080:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 450us (1374us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788917002.113084:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:1.0:1788917002.126110:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917002.127476:0:11923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113502336 00000100:00100000:2.0:1788917002.127491:0:11923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113502336 00000100:00100000:2.0:1788917002.127557:0:11923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:2.0:1788917002.127569:0:11923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+61:11541:x1875815113502336:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788917002.127827:0:11923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+62:11541:x1875815113502336:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 259us (1728us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788917002.127835:0:11923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:3.0:1788917002.132513:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917002.132669:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113502592 00000100:00100000:1.0:1788917002.132681:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113502592 00000100:00100000:1.0:1788917002.132747:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 180 00000100:00100000:1.0:1788917002.132759:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3720a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+62:11541:x1875815113502592:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788917002.132917:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3720a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+62:11541:x1875815113502592:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 161us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917002.132935:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 180 00000100:00100000:2.0:1788917002.140232:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917002.140404:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113502720 00000100:00100000:3.0:1788917002.140413:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113502720 00000100:00100000:3.0:1788917002.140486:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 181 00000100:00100000:3.0:1788917002.140644:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+62:11541:x1875815113502720:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788917002.140668:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917002.140692:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e306 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f784 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.140776:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e30d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.140791:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e30d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.140815:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e30d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917002.140853:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788917002.140873:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e30d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.140901:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e306 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f784 expref: 64 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.140917:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e30d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f784 expref: 63 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.140927:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6e02f3c600) 00010000:00010000:3.0:1788917002.140930:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788917002.140934:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e200, rc 0) 00000100:00100000:3.0:1788917002.140994:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+63:11541:x1875815113502720:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 499us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917002.141001:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 181 00000100:00100000:0.0:1788917002.148744:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917002.148829:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113502848 00000100:00100000:3.0:1788917002.148840:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113502848 00000100:00100000:3.0:1788917002.148890:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:3.0:1788917002.148905:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2373:x1875815113502848:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788917002.148922:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917002.148939:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e62b432d/0x51de7f756a83e314 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f78b expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788917002.148964:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0b509, blocks: 0x1 00010000:00010000:3.0:1788917002.148980:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=398s v=(0 0) 00010000:00010000:3.0:1788917002.148984:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788917002.148991:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e62b432d/0x51de7f756a83e314 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f78b expref: 8 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.149004:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e62b432d/0x51de7f756a83e314 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f78b expref: 8 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.149022:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18fc00, rc 0) 00000100:00100000:3.0:1788917002.149082:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36efb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2373:x1875815113502848:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 177us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917002.149090:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:3.0:1788917002.154487:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917002.155572:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113503104 00000100:00100000:0.0:1788917002.155591:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113503104 00000100:00100000:0.0:1788917002.155654:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 182 00000100:00100000:0.0:1788917002.155664:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+63:11541:x1875815113503104:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788917002.155790:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+63:11541:x1875815113503104:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 127us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917002.155809:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 182 00000100:00100000:3.0:1788917002.160205:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917002.160606:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113503232 00000100:00100000:0.0:1788917002.160618:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113503232 00000100:00100000:0.0:1788917002.160684:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:0.0:1788917002.160696:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3720b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:11541:x1875815113503232:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788917002.160717:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917002.160738:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f1e5875/0x51de7f756a83e31b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f792 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.160771:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e62b432d/0x51de7f756a83e314 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f78b expref: 9 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.160780:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788917002.160784:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788917002.160790:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f1e5875/0x51de7f756a83e31b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f792 expref: 9 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.160826:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e62b432d/0x51de7f756a83e314 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f78b expref: 9 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.160839:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e62b432d/0x51de7f756a83e314 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f78b expref: 9 pid: 6593 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917002.160864:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36efa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8068:1875815140761472:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917002.160961:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3c5f9780 going to sleep for 11 seconds 00000100:00100000:2.0:1788917002.169399:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917002.169453:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113503360 00000100:00100000:2.0:1788917002.169461:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113503360 00010000:00010000:2.0:1788917002.169514:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e62b432d/0x51de7f756a83e314 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f78b expref: 10 pid: 6593 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917002.169568:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:2.0:1788917002.169578:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d156300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+10:2374:x1875815113503360:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788917002.169594:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917002.169623:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e62b432d/0x51de7f756a83e314 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f78b expref: 10 pid: 6593 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.169639:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e62b432d/0x51de7f756a83e314 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f78b expref: 10 pid: 6593 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.169675:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788917002.169680:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788917002.169689:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f1e5875/0x51de7f756a83e31b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f792 expref: 10 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.169701:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f1e5875/0x51de7f756a83e31b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f792 expref: 10 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.169738:0:5777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008f1e5875/0x51de7f756a83e31b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f792 expref: 10 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917002.169754:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d154a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5777:1875815140761600:192.168.202.40@tcp:105: 00000100:00100000:2.0:1788917002.169854:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b16be40 going to sleep for 11 seconds 00010000:00010000:2.0:1788917002.169977:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e62b432d/0x51de7f756a83e314 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f78b expref: 10 pid: 6593 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917002.170005:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36efa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8068:1875815140761472:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788917002.170029:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f1e5875/0x51de7f756a83e31b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f792 expref: 9 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.170040:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2200, rc 0) 00000100:00100000:2.0:1788917002.170076:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3720b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:11541:x1875815113503232:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 9383us (9882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917002.170083:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:3.0:1788917002.174738:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d154a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5777:1875815140761600:192.168.202.40@tcp:105: 00010000:00010000:3.0:1788917002.174762:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917002.174882:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d156300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2374:x1875815113503360:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 5305us (5491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917002.174892:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:2.0:1788917002.178563:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917002.178644:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113503488 00000100:00100000:3.0:1788917002.178655:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113503488 00002000:00100000:3.0:1788917002.178708:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9a6e2d157800 x1875815113503488/t0(0) o4->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:383/0 lens 504/0 e 0 to 0 dl 1788917013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788917002.178720:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e2d157800 with x1875815113503488 ext(0->8) 00002000:00010000:3.0:1788917002.178725:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6e2d157800 00000100:00100000:3.0:1788917002.178759:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:3.0:1788917002.178768:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2373:x1875815113503488:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788917002.179370:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+10:2373:x1875815113503488:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 Request processed in 600us (814us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788917002.179380:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00002000:00100000:3.0:1788917002.179388:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9a6e2d157800 x1875815113503488/t4294967314(0) o4->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:383/0 lens 504/448 e 0 to 0 dl 1788917013 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788917002.179396:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e2d157800 with x1875815113503488 ext(0->8) 00002000:00010000:3.0:1788917002.179400:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6e2d157800 00000100:00100000:2.0:1788917002.182788:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917002.182900:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113503616 00000100:00100000:3.0:1788917002.182924:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113503616 00000100:00100000:3.0:1788917002.182997:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 183 00000100:00100000:3.0:1788917002.183008:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+63:11541:x1875815113503616:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788917002.243481:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:0.0:1788917002.243511:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:3.0:1788917002.243531:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:11541:x1875815113503616:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 Request processed in 60518us (60747us total) trans 0 rc 0/0 00000020:00080000:0.0:1788917002.243538:0:5814:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6e3c5f93c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788917002.243545:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e05345100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e3c5f9000 00000100:00100000:3.0:1788917002.243546:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 183 00000020:00080000:0.0:1788917002.243552:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e05345000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e3f459800 00000001:00080000:0.0:1788917002.243577:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000001:00080000:0.0:1788917002.243592:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1788917002.243643:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1788917002.243754:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:3.0:1788917002.243818:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140761728:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788917002.243874:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788917002.243929:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788917002.244648:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140761728 00000100:00100000:0.0:1788917002.244656:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140761728 00000100:00100000:3.0:1788917002.244688:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788917002.244701:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140761856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788917002.244724:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788917002.244738:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788917002.244838:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917002.244869:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140761856 00000100:00100000:1.0:1788917002.244873:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140761856 00000100:00100000:0.0:1788917002.244935:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140761728:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788917002.244950:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788917002.244960:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140761856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788917002.245078:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788917002.245080:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788917001 00002000:00010000:1.0:1788917002.245082:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788917002.245083:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788917001 -> 1788917001 00002000:00010000:1.0:1788917002.245085:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788917002.245116:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140761856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 158us (378us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788917002.245122:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1788917002.245176:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6e36ef9500/2, rc 0, transno 4294967315 00000100:00100000:1.0:1788917002.245181:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36ef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140761856:0@lo:2:osp-syn-1-0.0 00002000:00080000:0.0:1788917002.245343:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1788917002.245372:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa0b507, atime: 0x6aa0b507, ctime: 0x6aa0b507, blocks: 0x1 00010000:00010000:0.0:1788917002.245380:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e322 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917002.245396:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:0.0:1788917002.245396:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=398s v=(0 0) 00010000:00010000:0.0:1788917002.245402:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788917002.245408:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e322 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917002.245513:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113503744 00000100:00100000:1.0:1788917002.245518:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113503744 00000100:00080000:2.0:1788917002.245519:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788917002.245543:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:1.0:1788917002.245560:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+10:2374:x1875815113503744:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1788917002.246317:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e322 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.246333:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e322 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.246339:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e322 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.246357:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788917002.246374:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788917002.246383:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e322 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.246393:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3400 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788917002.246397:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e322 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.246407:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e322 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.246437:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e322 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.246451:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e322 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.246469:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917002.246471:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917002.246473:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917002.246854:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1875815140761728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1924us (2978us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788917002.246864:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:2.0:1788917002.246890:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6e2d0f5f80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788917002.246900:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140761728:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1788917002.273635:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1788917002.273656:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1788917002.273664:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1788917002.273886:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113503744:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 Request processed in 28329us (28484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917002.273899:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:2.0:1788917002.282570:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917002.285558:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113504000 00000100:00100000:3.0:1788917002.285573:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113504000 00000100:00100000:3.0:1788917002.285641:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 184 00000100:00100000:3.0:1788917002.285651:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:11541:x1875815113504000:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788917002.285713:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917002.285744:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e30d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f784 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.285764:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6e02f3c600) 00010000:00010000:3.0:1788917002.285769:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788917002.285798:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e329 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.285812:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.285821:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788917002.286086:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f2799b1f reply state 0000000081a75e38 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917002.286097:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788917002.286251:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:11541:x1875815113504000:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 600us (3689us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788917002.286260:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 184 00010000:00010000:0.0:1788917002.291096:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e329 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.291115:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e329 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.291125:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e329 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.291132:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917002.291137:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e329 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.291165:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e329 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.291208:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6e02f3c600) 00010000:00010000:0.0:1788917002.291211:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917002.291216:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e329 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.291223:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e329 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917002.294804:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917002.295238:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113504128 00000100:00100000:3.0:1788917002.295249:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113504128 00000100:00100000:3.0:1788917002.295320:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:3.0:1788917002.295331:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2373:x1875815113504128:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788917002.295608:0:8068:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788917002.295612:0:8068:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788917001 -> 1788917000 00002000:00010000:3.0:1788917002.295615:0:8068:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788916999 00002000:00010000:3.0:1788917002.295617:0:8068:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788917001 -> 1788917000 00002000:00010000:3.0:1788917002.295620:0:8068:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788917002.295688:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36ef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2373:x1875815113504128:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 357us (892us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788917002.295697:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:2.0:1788917002.305523:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917002.305612:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113504384 00000100:00100000:0.0:1788917002.305625:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113504384 00000100:00100000:0.0:1788917002.305690:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 185 00000100:00100000:0.0:1788917002.305702:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:11541:x1875815113504384:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788917002.305777:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e330 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.305796:0:8069:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83e2f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f776 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.305806:0:8069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e330 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.305840:0:8069:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83e2f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f776 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.305854:0:8069:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83e2f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f776 expref: 18 pid: 5792 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917002.305869:0:8069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36efb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140761984:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917002.305986:0:8069:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3c5f9480 going to sleep for 11 seconds 00000100:00100000:2.0:1788917002.311206:0:8069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36efb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140761984:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788917002.311239:0:8069:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e330 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917002.312071:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917002.312509:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113504512 00000100:00100000:1.0:1788917002.312528:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113504512 00010000:00010000:1.0:1788917002.312570:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83e2f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f776 expref: 19 pid: 5792 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917002.312712:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:1.0:1788917002.312723:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d155500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:2373:x1875815113504512:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788917002.313313:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788917002.313323:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83e2f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f776 expref: 19 pid: 5792 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917002.313337:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83e2f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f776 expref: 19 pid: 5792 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917002.313360:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83e2f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f776 expref: 19 pid: 5792 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917002.313378:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6e02f3c600) 00010000:00010000:1.0:1788917002.313383:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e330 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917002.313392:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e330 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917002.313401:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e330 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917002.313458:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788917002.313513:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d155500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:2373:x1875815113504512:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 792us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917002.313532:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 70 00010000:00010000:2.0:1788917002.314243:0:8069:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e330 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.314255:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e330 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.314286:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e330 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.314293:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e330 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.314300:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e330 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.314316:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917002.314320:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e330 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.314329:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e330 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.314340:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6e02f3c600) 00010000:00010000:2.0:1788917002.314343:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788917002.314347:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e330 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.314353:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e330 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917002.314426:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+17:11541:x1875815113504384:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 Request processed in 8716us (8903us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788917002.314436:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 185 00000100:00100000:2.0:1788917002.317258:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917002.317336:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113504640 00000100:00100000:0.0:1788917002.317346:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113504640 00000100:00100000:0.0:1788917002.317406:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:0.0:1788917002.317426:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2374:x1875815113504640:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788917002.317472:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007febd2ab/0x51de7f756a83e337 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.317493:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f1e5875/0x51de7f756a83e31b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f792 expref: 8 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.317503:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788917002.317508:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788917002.317513:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007febd2ab/0x51de7f756a83e337 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.317548:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f1e5875/0x51de7f756a83e31b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f792 expref: 8 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.317562:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f1e5875/0x51de7f756a83e31b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f792 expref: 8 pid: 8068 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917002.317578:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36efaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6593:1875815140762112:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917002.317660:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3c5f9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788917002.320507:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36efaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6593:1875815140762112:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788917002.320537:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007febd2ab/0x51de7f756a83e337 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917002.323309:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917002.323403:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113504768 00000100:00100000:3.0:1788917002.323425:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113504768 00010000:00010000:3.0:1788917002.323469:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f1e5875/0x51de7f756a83e31b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f792 expref: 9 pid: 8068 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917002.323514:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:3.0:1788917002.323523:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d157100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:2374:x1875815113504768:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917002.323540:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917002.323567:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f1e5875/0x51de7f756a83e31b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f792 expref: 9 pid: 8068 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.323695:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f1e5875/0x51de7f756a83e31b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f792 expref: 9 pid: 8068 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.323724:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f1e5875/0x51de7f756a83e31b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f792 expref: 9 pid: 8068 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.323747:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788917002.323752:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788917002.323759:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007febd2ab/0x51de7f756a83e337 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.323771:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007febd2ab/0x51de7f756a83e337 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.323809:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917002.323878:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d157100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2374:x1875815113504768:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 356us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917002.323887:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 71 00010000:00010000:0.0:1788917002.324329:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007febd2ab/0x51de7f756a83e337 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.324354:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007febd2ab/0x51de7f756a83e337 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.324381:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007febd2ab/0x51de7f756a83e337 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.324390:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007febd2ab/0x51de7f756a83e337 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.324398:0:6593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007febd2ab/0x51de7f756a83e337 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.324405:0:6593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2800 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788917002.324409:0:6593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007febd2ab/0x51de7f756a83e337 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.324428:0:6593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007febd2ab/0x51de7f756a83e337 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.324441:0:6593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007febd2ab/0x51de7f756a83e337 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.324448:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007febd2ab/0x51de7f756a83e337 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917002.324516:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113504640:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 Request processed in 7101us (7266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917002.324525:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:2.0:1788917002.327291:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917002.327364:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113505024 00000100:00100000:0.0:1788917002.327375:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113505024 00000100:00100000:0.0:1788917002.327438:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 186 00000100:00100000:0.0:1788917002.327450:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+17:11541:x1875815113505024:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788917002.327537:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e33e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.327554:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e33e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.327565:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e33e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.327787:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e345 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.327800:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e2ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f77d expref: 18 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.327808:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e345 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.327843:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e2ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f77d expref: 18 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.327872:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e2ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f77d expref: 18 pid: 8069 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917002.327887:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36efaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1875815140762240:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917002.327970:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3c5f9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788917002.331508:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917002.332553:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36efaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1875815140762240:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788917002.332588:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e345 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917002.332674:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113505152 00000100:00100000:2.0:1788917002.332681:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113505152 00010000:00010000:2.0:1788917002.332724:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e2ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f77d expref: 19 pid: 8069 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917002.332776:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:2.0:1788917002.332786:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:2374:x1875815113505152:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788917002.332822:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917002.332830:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e2ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f77d expref: 19 pid: 8069 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.332843:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e2ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f77d expref: 19 pid: 8069 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.332869:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e2ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f77d expref: 19 pid: 8069 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.332890:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6e02f3c600) 00010000:00010000:2.0:1788917002.332895:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e345 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.332905:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e345 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.332914:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e345 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917002.332946:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788917002.333011:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:2374:x1875815113505152:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 225us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917002.333019:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 72 00010000:00010000:0.0:1788917002.333231:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e345 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.333239:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e345 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788917002.333450:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788917002.333604:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788917002.333649:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788917002.333737:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36efaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5794:1875815140762368:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788917002.333795:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917002.333824:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3c5f9480 going to sleep for 11 seconds 00000100:00100000:2.0:1788917002.333993:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140762368 00000100:00100000:2.0:1788917002.333999:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140762368 00000100:00100000:2.0:1788917002.334042:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788917002.334050:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5794:x1875815140762368:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788917002.334133:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36efb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5794:x1875815140762368:12345-0@lo:1000:mdt00_002.0 Request processed in 84us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917002.334183:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788917002.334275:0:5794:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788917002.334281:0:5794:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6e36ef9500, transno 4294967315 00000100:00100000:0.0:1788917002.334302:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36efaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5794:1875815140762368:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788917002.334745:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788917002.334795:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e36efaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5794:1875815140762496:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788917002.334829:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917002.334847:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3c5f9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788917002.334861:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140762496 00000100:00100000:0.0:1788917002.334864:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140762496 00000100:00100000:0.0:1788917002.334885:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788917002.334891:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5794:x1875815140762496:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788917002.335034:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36efa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5794:x1875815140762496:12345-0@lo:1000:mdt00_002.0 Request processed in 143us (204us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788917002.335041:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788917002.335070:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e36efaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5794:1875815140762496:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788917002.335096:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e345 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.335106:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e345 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.335113:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e345 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.335119:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917002.335125:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e345 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.335133:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e345 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.335174:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6e02f3c600) 00010000:00010000:0.0:1788917002.335178:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788917002.335183:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e345 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.335199:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e345 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.335231:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e27a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.335238:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e27a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.335244:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e27a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.335249:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18ea00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917002.335252:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e27a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.335258:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e27a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.335267:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceeb00) 00010000:00010000:0.0:1788917002.335269:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788917002.335271:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e27a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.335276:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e27a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.335295:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e34c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.335309:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e296 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f761 expref: 21 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.335323:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e34c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.335347:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e296 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f761 expref: 21 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.335359:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e296 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f761 expref: 21 pid: 8069 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917002.335371:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a83b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1875815140762624:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917002.335437:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3c5f9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788917002.338822:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a83b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1875815140762624:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788917002.338851:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e34c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917002.340448:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917002.340565:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113505280 00000100:00100000:3.0:1788917002.340573:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113505280 00010000:00010000:3.0:1788917002.340612:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e296 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f761 expref: 22 pid: 8069 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917002.340658:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:3.0:1788917002.340668:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d155f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+22:2374:x1875815113505280:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917002.340696:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917002.340704:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e296 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f761 expref: 22 pid: 8069 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.340716:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e296 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f761 expref: 22 pid: 8069 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.340738:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e296 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f761 expref: 22 pid: 8069 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.340755:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceeb00) 00010000:00010000:3.0:1788917002.340759:0:6606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e34c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.340770:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e34c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.340778:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e34c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.340930:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917002.340992:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d155f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+21:2374:x1875815113505280:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 324us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917002.341000:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 73 00010000:00010000:0.0:1788917002.341220:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e34c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.341230:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e34c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.341243:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e34c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.341249:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e34c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.341256:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e34c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.341269:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917002.341274:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e34c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.341281:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e34c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.341291:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceeb00) 00010000:00010000:0.0:1788917002.341293:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917002.341296:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e34c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.341301:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e34c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.341312:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e33e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.341317:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e33e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.341322:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e33e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.341326:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917002.341328:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e33e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.341333:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e33e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.341350:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceeb00) 00010000:00010000:0.0:1788917002.341352:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788917002.341355:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e33e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.341361:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e33e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917002.341720:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:11541:x1875815113505024:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 14271us (14435us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1788917002.341729:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 186 00000020:00080000:0.0:1788917002.341733:0:5794:0:(tgt_main.c:816:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788917002.342372:0:11537:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788917002.342378:0:11537:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917002.343650:0:11537:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788917002.343665:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788917002.344502:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917002.344574:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113505536 00000100:00100000:0.0:1788917002.344584:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113505536 00000100:00100000:0.0:1788917002.344635:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:0.0:1788917002.344645:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e08cff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:11541:x1875815113505536:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788917002.345330:0:5795:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788917002.345443:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1788917002.345487:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e353 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.345503:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.345515:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.345524:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e353 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.345544:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e353 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.345550:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e353 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917002.345571:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788917002.345667:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e08cff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+22:11541:x1875815113505536:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 1021us (1168us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788917002.345675:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 50 00000020:00080000:0.0:1788917002.345680:0:5795:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788917002.345779:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917002.345787:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e353 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.345794:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3a00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917002.345805:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e353 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.345814:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e353 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.345828:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a6e03d86900) 00010000:00010000:3.0:1788917002.345831:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788917002.345836:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e353 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.345842:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e353 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917002.345859:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917002.345862:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917002.345863:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917003.039976:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788917003.336912:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1788917003.336932:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000040:00080000:1.0:1788917003.614864:0:12415:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788917003.614874:0:12415:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917003.614906:0:12415:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788917003.614911:0:12415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788917003.734929:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917003.737879:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113505792 00000100:00100000:3.0:1788917003.737892:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113505792 00000100:00100000:3.0:1788917003.737947:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 187 00000100:00100000:3.0:1788917003.737958:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+22:11559:x1875815113505792:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788917003.737983:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917003.738002:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e35a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f799 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.738265:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83e361 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.738282:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83e361 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.738294:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83e361 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917003.738312:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1788917003.739441:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e35a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f799 expref: 25 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.739462:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83e361 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f799 expref: 24 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.739471:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:3.0:1788917003.739474:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788917003.739477:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18ee00, rc 0) 00000100:00100000:3.0:1788917003.739621:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+24:11559:x1875815113505792:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1663us (4699us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788917003.739630:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 187 00000100:00100000:3.0:1788917003.746669:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917003.746703:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113505920 00000100:00100000:3.0:1788917003.746712:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113505920 00000100:00100000:3.0:1788917003.746762:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 188 00000100:00100000:3.0:1788917003.746772:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+24:11559:x1875815113505920:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:3.0:1788917003.746849:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e36f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.746867:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e36f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.746878:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e36f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.746892:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e376 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.746905:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.746911:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747223:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e37d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747232:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e37d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747239:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e37d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788917003.747278:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e37d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747291:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e36f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747297:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e36f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747304:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e36f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747310:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917003.747313:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e36f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747322:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e36f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747339:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:3.0:1788917003.747343:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917003.747348:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e36f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747354:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e36f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747364:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747370:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e376 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747376:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e376 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747381:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917003.747383:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e376 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747389:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e376 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747396:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788917003.747398:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917003.747414:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e376 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747421:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e376 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747444:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e37d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747450:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e37d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747456:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e37d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747461:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917003.747464:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e37d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747468:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e37d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.747476:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceec00) 00010000:00010000:3.0:1788917003.747478:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917003.747481:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e37d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.748590:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e37d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917003.748685:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37308380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+24:11559:x1875815113505920:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 1912us (2023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917003.748694:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 188 00000100:00100000:1.0:1788917003.789788:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917003.789855:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113506176 00000100:00100000:3.0:1788917003.789865:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113506176 00000100:00100000:3.0:1788917003.789957:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 189 00000100:00100000:3.0:1788917003.789974:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+24:11562:x1875815113506176:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788917003.789994:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917003.790020:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e384 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f7a0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790093:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e38b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790103:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e38b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790111:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e38b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790121:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e392 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790126:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790130:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790516:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e399 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790525:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e399 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790532:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e399 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917003.790551:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788917003.790647:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e38b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790655:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e38b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790662:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e38b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790669:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917003.790673:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e38b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790681:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e38b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790693:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:3.0:1788917003.790696:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917003.790700:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e38b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790706:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e38b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790730:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790737:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e392 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790753:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e392 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790758:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917003.790762:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e392 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790768:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e392 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790776:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e02ceec00) 00010000:00010000:3.0:1788917003.790778:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917003.790782:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e392 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790788:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e392 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790828:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e384 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7a0 expref: 27 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790842:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e399 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7a0 expref: 26 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.790850:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788917003.790852:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788917003.790854:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f600, rc 0) 00000100:00100000:3.0:1788917003.790916:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+26:11562:x1875815113506176:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 942us (1135us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788917003.790933:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 189 00000100:00100000:0.0:1788917003.795821:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917003.795982:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113506304 00000100:00100000:3.0:1788917003.795993:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113506304 00000100:00100000:3.0:1788917003.796091:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 190 00000100:00100000:3.0:1788917003.796103:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+26:11562:x1875815113506304:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:3.0:1788917003.796214:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e3a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.796233:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.796245:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.796276:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.796285:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e3a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.796293:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e3a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.796300:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18ea00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917003.796306:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e3a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.796315:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e3a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.796326:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788917003.796343:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788917003.796348:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e3a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.796354:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e3a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917003.796447:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+26:11562:x1875815113506304:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 345us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917003.796456:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 190 00000100:00100000:3.0:1788917003.798781:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917003.798873:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113506560 00000100:00100000:0.0:1788917003.798883:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113506560 00000100:00100000:0.0:1788917003.798933:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:0.0:1788917003.798941:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+26:11562:x1875815113506560:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1788917003.799209:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+27:11562:x1875815113506560:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 267us (433us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788917003.799217:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:1.0:1788917003.821461:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917003.821533:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113506816 00000100:00100000:2.0:1788917003.821544:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113506816 00000100:00100000:2.0:1788917003.821603:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 191 00000100:00100000:2.0:1788917003.821615:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+27:11089:x1875815113506816:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1788917003.821644:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917003.821664:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83e3ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f7a7 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.821787:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e3b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.821803:0:8069:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e399 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7a0 expref: 28 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.821812:0:8069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e3b5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.821847:0:8069:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e399 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7a0 expref: 28 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.821875:0:8069:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e399 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7a0 expref: 28 pid: 5792 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917003.822189:0:8069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d154000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140762752:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788917003.822301:0:8069:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3730ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788917003.825046:0:8069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d154000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140762752:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788917003.825049:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917003.825167:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113506944 00000100:00100000:1.0:1788917003.825175:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113506944 00010000:00010000:1.0:1788917003.825215:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e399 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7a0 expref: 29 pid: 5792 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917003.825260:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 74 00000100:00100000:1.0:1788917003.825271:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d154700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:2373:x1875815113506944:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788917003.825287:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788917003.825295:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e399 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7a0 expref: 29 pid: 5792 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917003.825308:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e399 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7a0 expref: 29 pid: 5792 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917003.825344:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e399 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7a0 expref: 29 pid: 5792 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917003.825362:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:1.0:1788917003.825367:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e3b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917003.825390:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e3b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917003.825396:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e3b5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917003.825426:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788917003.825486:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d154700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+28:2373:x1875815113506944:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 217us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917003.825501:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 74 00010000:00010000:3.0:1788917003.826141:0:8069:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e3b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.826216:0:8069:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e3b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.826225:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e3b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917003.826247:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788917003.826564:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83e3ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7a7 expref: 29 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.826588:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e3b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7a7 expref: 28 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.826597:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:2.0:1788917003.826601:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788917003.826604:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00030000, rc 0) 00000100:00100000:2.0:1788917003.826655:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+28:11089:x1875815113506816:12345-192.168.202.40@tcp:101:bash.0 Request processed in 5043us (5206us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788917003.826665:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 191 00000100:00100000:2.0:1788917003.830367:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917003.830554:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113507200 00000100:00100000:0.0:1788917003.830565:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113507200 00000100:00100000:0.0:1788917003.830628:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 192 00000100:00100000:0.0:1788917003.830638:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+28:11089:x1875815113507200:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:0.0:1788917003.831059:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e3c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.831078:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e3c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.831098:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e3c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788917003.831259:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1788917003.831285:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007b842d86 reply state 00000000e1e17152 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e3c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917003.831356:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788917003.831421:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1788917003.831564:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+32:11089:x1875815113507200:12345-192.168.202.40@tcp:36:bash.0 Request processed in 926us (1204us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1788917003.831572:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 192 00000020:00080000:0.0:1788917003.831577:0:5794:0:(tgt_main.c:816:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788917003.832994:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e3c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.833013:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e3c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.833018:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e3c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.833022:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917003.833025:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e3c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.833031:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e3c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.833042:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:0.0:1788917003.833059:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917003.833063:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e3c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.833067:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e3c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917003.833841:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917003.833894:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113507328 00000100:00100000:3.0:1788917003.833903:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113507328 00000100:00100000:3.0:1788917003.833953:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 193 00000100:00100000:3.0:1788917003.833964:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:11089:x1875815113507328:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1788917003.833987:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917003.834005:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e3ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f7ae expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.834071:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e3ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7ae expref: 32 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.834085:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e3ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7ae expref: 32 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.834119:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788917003.834123:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788917003.834125:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18ea00, rc 0) 00000100:00100000:3.0:1788917003.834609:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+32:11089:x1875815113507328:12345-192.168.202.40@tcp:101:bash.0 Request processed in 643us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917003.834616:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 193 00000100:00100000:1.0:1788917003.836754:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917003.836820:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113507456 00000100:00100000:0.0:1788917003.836829:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113507456 00000100:00080000:2.0:1788917003.836890:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788917003.836946:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:0.0:1788917003.836956:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:11089:x1875815113507456:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1788917003.836972:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917003.836994:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e3d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f7b5 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788917003.837021:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa0b508, atime: 0x6aa0b507, ctime: 0x6aa0b508, blocks: 0xb 00010000:00010000:0.0:1788917003.837043:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=399s v=(0 0) 00010000:00010000:0.0:1788917003.837048:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788917003.837069:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e3d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7b5 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.837087:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e3d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7b5 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.837100:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2c00, rc 0) 00000100:00100000:0.0:1788917003.837190:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:11089:x1875815113507456:12345-192.168.202.40@tcp:101:bash.0 Request processed in 234us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917003.837197:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:3.0:1788917003.839575:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917003.839627:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113507584 00000100:00100000:2.0:1788917003.839637:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113507584 00002000:00010000:2.0:1788917003.839676:0:6597:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1788917003.839681:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e13e1e300 with x1875815113507584 ext(0->18446744073709551615) 00002000:00010000:2.0:1788917003.839693:0:6597:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6e13e1e300. 00000100:00100000:2.0:1788917003.839789:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:2.0:1788917003.839802:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2374:x1875815113507584:12345-192.168.202.40@tcp:10:bash.0 00002000:00010000:2.0:1788917003.840207:0:6597:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788917003.840212:0:6597:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788917000 -> 1788917002 00002000:00010000:2.0:1788917003.840215:0:6597:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788916999 -> 1788916999 00002000:00010000:2.0:1788917003.840217:0:6597:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788917000 -> 1788917002 00002000:00010000:2.0:1788917003.840220:0:6597:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788917003.840283:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:2374:x1875815113507584:12345-192.168.202.40@tcp:10:bash.0 Request processed in 483us (716us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788917003.840300:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00002000:00010000:2.0:1788917003.840305:0:6597:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1788917003.840308:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e13e1e300 with x1875815113507584 ext(0->18446744073709551615) 00002000:00010000:2.0:1788917003.840313:0:6597:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6e13e1e300. 00000100:00100000:2.0:1788917003.896337:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917003.896477:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113507712 00000100:00100000:3.0:1788917003.896488:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113507712 00000100:00100000:3.0:1788917003.896592:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 194 00000100:00100000:3.0:1788917003.896603:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+32:11576:x1875815113507712:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:3.0:1788917003.896684:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e3d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.896704:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e3d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.896729:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e3d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.896746:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e3df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.896754:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e3df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.896762:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e3df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897586:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e3e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897599:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e3e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897608:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e3e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788917003.897652:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e3e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897666:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e3d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897673:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e3d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897681:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e3d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897687:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917003.897692:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e3d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897700:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e3d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897778:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:3.0:1788917003.897782:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917003.897787:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e3d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897801:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e3d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897816:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e3df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897823:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e3df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897830:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e3df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897835:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917003.897839:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e3df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897845:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e3df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897853:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e02ceec00) 00010000:00010000:3.0:1788917003.897856:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917003.897859:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e3df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897866:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e3df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897880:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e3e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897886:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e3e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897899:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e3e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897905:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917003.897908:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e3e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897915:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e3e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897923:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788917003.897926:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917003.897929:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e3e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917003.897935:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e3e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917003.898410:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+32:11576:x1875815113507712:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 1795us (2070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917003.898421:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 194 00000100:00100000:1.0:1788917003.928608:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917003.928712:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113507968 00000100:00100000:2.0:1788917003.928722:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113507968 00000100:00100000:2.0:1788917003.928784:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 195 00000100:00100000:2.0:1788917003.928796:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+32:11579:x1875815113507968:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788917003.928820:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917003.928856:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e3ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f7bc expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.928939:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e3f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.928954:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e3f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.928966:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e3f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.928981:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e3fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.928988:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e3fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.928995:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e3fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929319:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83e402 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929326:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83e402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929331:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83e402 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917003.929339:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788917003.929427:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e3f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929439:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e3f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929443:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e3f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929447:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917003.929451:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e3f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929456:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e3f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929465:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:2.0:1788917003.929466:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917003.929469:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e3f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929473:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e3f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929485:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e3fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929489:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e3fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929493:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e3fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929495:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00030e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917003.929500:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e3fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929504:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e3fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929509:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e02f3c100) 00010000:00010000:2.0:1788917003.929510:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917003.929512:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e3fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929515:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e3fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929551:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e3ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7bc expref: 35 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929559:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83e402 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7bc expref: 34 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.929563:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:2.0:1788917003.929565:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788917003.929566:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031c00, rc 0) 00000100:00100000:2.0:1788917003.929623:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+34:11579:x1875815113507968:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 831us (1027us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788917003.929629:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 195 00000100:00100000:2.0:1788917003.932870:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917003.933541:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113508096 00000100:00100000:0.0:1788917003.933553:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113508096 00000100:00100000:0.0:1788917003.933680:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 196 00000100:00100000:0.0:1788917003.933691:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+34:11579:x1875815113508096:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:0.0:1788917003.933777:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e410 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.933799:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e3b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7a7 expref: 34 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.933810:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e410 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.933848:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e3b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7a7 expref: 34 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.933863:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e3b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7a7 expref: 34 pid: 8069 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917003.933878:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1875815140762880:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917003.933984:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e02b9bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788917003.943032:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917003.943850:0:11923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113508352 00000100:00100000:2.0:1788917003.943861:0:11923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113508352 00000100:00100000:2.0:1788917003.943933:0:11923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:2.0:1788917003.943958:0:11923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+35:5591:x1875815113508352:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788917003.944352:0:11923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+36:5591:x1875815113508352:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 396us (1330us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788917003.944361:0:11923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:3.0:1788917003.948669:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5794:1875815140762880:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788917003.948701:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e410 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917003.948920:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917003.949043:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113508480 00000100:00100000:2.0:1788917003.949051:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113508480 00010000:00010000:2.0:1788917003.949085:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e3b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7a7 expref: 36 pid: 8069 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917003.949121:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:2.0:1788917003.949129:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e408e3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+36:2373:x1875815113508480:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788917003.949160:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917003.949168:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e3b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7a7 expref: 36 pid: 8069 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.949179:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e3b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7a7 expref: 36 pid: 8069 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.949201:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e3b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7a7 expref: 36 pid: 8069 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.949218:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:2.0:1788917003.949223:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e410 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.949233:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.949256:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e410 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917003.949284:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788917003.949342:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e408e3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+35:2373:x1875815113508480:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 212us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917003.949349:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 75 00010000:00010000:0.0:1788917003.949501:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.949508:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.949539:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.949552:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e410 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.949559:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e410 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.949565:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917003.949569:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e410 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.949577:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e410 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.949586:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:0.0:1788917003.949589:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788917003.949593:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e410 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917003.949598:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e410 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917003.949640:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+34:11579:x1875815113508096:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 15950us (16782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917003.949647:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 196 00000100:00100000:1.0:1788917003.953808:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917003.953953:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113508736 00000100:00100000:0.0:1788917003.953963:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113508736 00000100:00100000:0.0:1788917003.954111:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:0.0:1788917003.954122:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+34:11579:x1875815113508736:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1788917003.954380:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+35:11579:x1875815113508736:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 260us (582us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788917003.954413:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:1.0:1788917004.041868:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917004.041977:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113508992 00000100:00100000:2.0:1788917004.041988:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113508992 00000100:00100000:2.0:1788917004.042072:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 197 00000100:00100000:2.0:1788917004.042084:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+35:11590:x1875815113508992:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:2.0:1788917004.042109:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917004.042131:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e417 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f7c3 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042242:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e41e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042256:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e41e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042269:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e41e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042282:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e425 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042289:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042314:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042645:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e42c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042654:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e42c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042663:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e42c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917004.042674:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788917004.042777:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e41e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042786:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e41e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042794:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e41e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042802:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917004.042807:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e41e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042815:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e41e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042829:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:2.0:1788917004.042832:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917004.042843:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e41e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042851:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e41e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042869:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e425 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042876:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e425 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042882:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e425 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042888:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00030e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917004.042891:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e425 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042898:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e425 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042907:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e02f3c100) 00010000:00010000:2.0:1788917004.042910:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917004.042913:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e425 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042920:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e425 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042962:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e417 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7c3 expref: 38 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042989:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e42c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7c3 expref: 37 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.042997:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:2.0:1788917004.042999:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788917004.043001:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031600, rc 0) 00000100:00100000:2.0:1788917004.043058:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+37:11590:x1875815113508992:12345-192.168.202.40@tcp:101:cat.0 Request processed in 977us (1197us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788917004.043066:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 197 00000100:00080000:0.0:1788917004.043173:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917004.048517:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917004.048635:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113509248 00000100:00100000:0.0:1788917004.048645:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113509248 00000100:00100000:0.0:1788917004.048746:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:0.0:1788917004.048756:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+37:11590:x1875815113509248:12345-192.168.202.40@tcp:35:cat.0 00000100:00100000:0.0:1788917004.049041:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+38:11590:x1875815113509248:12345-192.168.202.40@tcp:35:cat.0 Request processed in 286us (533us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788917004.049050:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:1.0:1788917004.062385:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917004.062477:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113509504 00000100:00100000:3.0:1788917004.062489:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113509504 00000100:00100000:3.0:1788917004.062544:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 198 00000100:00100000:3.0:1788917004.062551:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+38:11591:x1875815113509504:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:3.0:1788917004.062620:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788917004.062647:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e42c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7c3 expref: 38 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.062666:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031c00/0x51de7f756a83e402 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7bc expref: 37 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.062674:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e3ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7ae expref: 36 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.062682:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceee00) 00010000:00010000:3.0:1788917004.062691:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788917004.062708:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e43a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.062718:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e43a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.062725:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e43a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.062737:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e441 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.062744:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e441 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.062750:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e441 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.063320:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917004.063774:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e448 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.063788:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e448 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.063797:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e448 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788917004.064471:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788917004.064482:0:5793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 400096335154ns, next at 401096331977ns, rc = 0 00010000:00010000:3.0:1788917004.064540:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e44f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064551:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e44f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064561:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e44f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064569:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e44f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064576:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e44f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064583:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e44f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064607:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788917004.064628:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e448 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064642:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e448 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064649:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e448 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064656:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917004.064660:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e448 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064668:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e448 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064680:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceea00) 00010000:00010000:3.0:1788917004.064683:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788917004.064689:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e448 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064695:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e448 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064713:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e43a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064719:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e43a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064726:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e43a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064731:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917004.064739:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e43a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064746:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e43a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064755:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:3.0:1788917004.064757:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917004.064759:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e43a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.064764:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e43a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788917004.064774:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ee8ee787 reply state 00000000ed2be8e2 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e441 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917004.064784:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788917004.064885:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+37:11591:x1875815113509504:12345-192.168.202.40@tcp:36:rm.0 Request processed in 2330us (2506us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788917004.064896:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 198 00010000:00010000:2.0:1788917004.065416:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788917004.065424:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e44f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.065432:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788917004.065435:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e44f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.065443:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e44f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.065455:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a6e02ceea00) 00010000:00010000:2.0:1788917004.065457:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788917004.065460:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e44f lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.065466:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e44f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.065486:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917004.065497:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917004.065499:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917004.068036:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e441 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.068054:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e441 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.068061:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e441 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.068067:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917004.068072:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e441 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.068079:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e441 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.068096:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e02ceec00) 00010000:00010000:2.0:1788917004.068099:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917004.068105:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e441 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.068111:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e441 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917004.105873:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917004.106003:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113509760 00000100:00100000:3.0:1788917004.106013:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113509760 00000100:00100000:3.0:1788917004.106077:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 199 00000100:00100000:3.0:1788917004.106088:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+36:11597:x1875815113509760:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1788917004.106116:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917004.106139:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e456 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f7ca expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.106311:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e45d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.106341:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e45d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.106353:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e45d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.106368:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e464 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.106376:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e464 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.106383:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e464 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788917004.106988:0:5792:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788917004.107166:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e46b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.107179:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e46b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.107188:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e46b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.107223:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e45d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.107230:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e45d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.107237:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e45d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.107250:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917004.107255:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e45d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.107263:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e45d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.107276:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:3.0:1788917004.107279:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917004.107283:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e45d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.107290:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e45d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788917004.107305:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bfe544da reply state 00000000bd09a5c8 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e464 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917004.107314:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788917004.107342:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e456 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7ca expref: 39 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.107356:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e46b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7ca expref: 38 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.107364:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee800) 00010000:00010000:3.0:1788917004.107366:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788917004.107369:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e600, rc 0) 00000100:00100000:3.0:1788917004.107454:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+39:11597:x1875815113509760:12345-192.168.202.40@tcp:101:bash.0 Request processed in 1368us (1591us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788917004.107469:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 199 00010000:00010000:2.0:1788917004.111004:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e464 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.111022:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e464 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.111030:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e464 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.111050:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18ea00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917004.111055:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e464 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.111063:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e464 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.111080:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e02ceee00) 00010000:00010000:2.0:1788917004.111083:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917004.111088:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e464 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.111095:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e464 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917004.111871:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917004.111946:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113509888 00000100:00100000:2.0:1788917004.111955:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113509888 00000100:00100000:2.0:1788917004.112033:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:2.0:1788917004.112042:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2371:x1875815113509888:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1788917004.112060:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917004.112080:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5ecb114/0x51de7f756a83e479 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f7d1 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788917004.112107:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788917004.112128:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1788917004.112133:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788917004.112142:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5ecb114/0x51de7f756a83e479 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d1 expref: 6 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.112205:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5ecb114/0x51de7f756a83e479 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d1 expref: 6 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.112218:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00030000, rc 0) 00000100:00100000:2.0:1788917004.112275:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37199180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2371:x1875815113509888:12345-192.168.202.40@tcp:101:bash.0 Request processed in 234us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917004.112283:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00080000:0.0:1788917004.112344:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917004.115256:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917004.115310:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113510016 00000100:00100000:3.0:1788917004.115320:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113510016 00000100:00100000:3.0:1788917004.115374:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:3.0:1788917004.115385:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:11597:x1875815113510016:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1788917004.115412:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917004.115431:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83e480 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f7d8 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.115464:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5ecb114/0x51de7f756a83e479 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d1 expref: 7 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.115474:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788917004.115478:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788917004.115484:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83e480 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d8 expref: 7 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.115519:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d5ecb114/0x51de7f756a83e479 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d1 expref: 7 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.115534:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d5ecb114/0x51de7f756a83e479 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d1 expref: 7 pid: 6592 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917004.115551:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e13e1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8068:1875815140763008:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788917004.115640:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e0b456d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788917004.118438:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e13e1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8068:1875815140763008:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788917004.118472:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83e480 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d8 expref: 7 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.118493:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e800, rc 0) 00000100:00100000:2.0:1788917004.118553:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36db3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:11597:x1875815113510016:12345-192.168.202.40@tcp:101:bash.0 Request processed in 3169us (3305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917004.118563:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:1.0:1788917004.119253:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917004.120472:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113510144 00000100:00100000:2.0:1788917004.120482:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113510144 00010000:00010000:2.0:1788917004.120525:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d5ecb114/0x51de7f756a83e479 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d1 expref: 7 pid: 6592 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917004.120568:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:2.0:1788917004.120578:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37199880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2373:x1875815113510144:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788917004.120594:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917004.120630:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d5ecb114/0x51de7f756a83e479 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d1 expref: 7 pid: 6592 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.120644:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5ecb114/0x51de7f756a83e479 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d1 expref: 7 pid: 6592 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.120669:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5ecb114/0x51de7f756a83e479 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d1 expref: 7 pid: 6592 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.120687:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788917004.120692:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788917004.120701:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83e480 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d8 expref: 6 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.120725:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83e480 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d8 expref: 6 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.125135:0:5779:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83e480 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d8 expref: 6 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917004.125176:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d156300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5779:1875815140763136:192.168.202.40@tcp:105: 00000100:00100000:2.0:1788917004.125269:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3730ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788917004.129471:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917004.129627:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d156300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5779:1875815140763136:192.168.202.40@tcp:105: 00010000:00010000:2.0:1788917004.129655:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788917004.129786:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113510400 00000100:00100000:1.0:1788917004.129794:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113510400 00000100:00100000:2.0:1788917004.129807:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37199880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2373:x1875815113510144:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 9230us (10555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917004.129827:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:1.0:1788917004.129854:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:1.0:1788917004.129864:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f37ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+38:11597:x1875815113510400:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:1.0:1788917004.130200:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f37ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+39:11597:x1875815113510400:12345-192.168.202.40@tcp:35:bash.0 Request processed in 337us (738us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788917004.130207:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:0.0:1788917004.264394:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917004.265008:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113510528 00000100:00100000:3.0:1788917004.265019:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113510528 00000100:00100000:3.0:1788917004.265119:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 200 00000100:00100000:3.0:1788917004.265130:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+39:11613:x1875815113510528:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788917004.265192:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917004.265215:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e487 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f7df expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.265284:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e48e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.265298:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e48e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.265310:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e48e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917004.265373:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1788917004.265377:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788917004.265414:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e48e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.265591:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e487 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7df expref: 41 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.265612:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e48e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7df expref: 40 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.265622:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:3.0:1788917004.265625:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788917004.265643:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f800, rc 0) 00000100:00100000:2.0:1788917004.265990:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+40:11613:x1875815113510528:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 859us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917004.266005:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 200 00000100:00100000:3.0:1788917004.269328:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917004.269572:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113510784 00000100:00100000:2.0:1788917004.269583:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113510784 00000100:00100000:2.0:1788917004.269740:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 201 00000100:00100000:2.0:1788917004.269753:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e13e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+40:11613:x1875815113510784:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788917004.269777:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917004.269799:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e495 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f7e6 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.269917:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e49c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.269932:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e49c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.269945:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e49c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917004.269957:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788917004.270105:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e495 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7e6 expref: 43 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.270128:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e49c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7e6 expref: 42 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.270205:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee800) 00010000:00010000:2.0:1788917004.270208:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788917004.270211:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00030e00, rc 0) 00000100:00100000:2.0:1788917004.270270:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e13e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+42:11613:x1875815113510784:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 520us (952us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788917004.270277:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 201 00000100:00100000:1.0:1788917004.273307:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917004.273487:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917004.273559:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113510912 00000100:00100000:2.0:1788917004.273569:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113510912 00000100:00100000:2.0:1788917004.273634:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:2.0:1788917004.273645:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+42:2372:x1875815113510912:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788917004.273661:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917004.273688:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e49c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7e6 expref: 42 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.273720:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee800) 00010000:00010000:2.0:1788917004.273725:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788917004.273789:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+41:2372:x1875815113510912:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 145us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917004.273796:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:0.0:1788917004.276730:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113511168 00000100:00100000:0.0:1788917004.276744:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113511168 00000100:00100000:0.0:1788917004.276866:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 202 00000100:00100000:0.0:1788917004.276877:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3719bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+41:11613:x1875815113511168:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1788917004.276912:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917004.276935:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e4aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f7ed expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.277035:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e4b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.277050:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e4b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.277242:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e4b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917004.277256:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788917004.277388:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e4aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7ed expref: 44 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.277418:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e4b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7ed expref: 43 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.277571:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee800) 00010000:00010000:0.0:1788917004.277575:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788917004.277578:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3a00, rc 0) 00000100:00100000:0.0:1788917004.277644:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3719bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+43:11613:x1875815113511168:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 768us (4498us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788917004.277651:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 202 00000100:00100000:3.0:1788917004.282291:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917004.282332:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113511296 00000100:00100000:0.0:1788917004.282344:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113511296 00000100:00100000:0.0:1788917004.282416:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:0.0:1788917004.282809:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+6:2373:x1875815113511296:12345-192.168.202.40@tcp:1:lfs.0 00010000:00010000:0.0:1788917004.282866:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83e4bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.282891:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83e480 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d8 expref: 6 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.282902:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788917004.282920:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788917004.282925:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83e4bf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.282971:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83e480 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d8 expref: 6 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.282986:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83e480 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d8 expref: 6 pid: 8068 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917004.283003:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f379180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1875815140763264:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917004.283116:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e02b9bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788917004.286615:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917004.286688:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113511424 00000100:00100000:3.0:1788917004.286697:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113511424 00002000:00100000:3.0:1788917004.286753:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9a6e3719a300 x1875815113511424/t0(0) o4->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:385/0 lens 504/0 e 0 to 0 dl 1788917015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788917004.286765:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e3719a300 with x1875815113511424 ext(0->8) 00010000:00010000:3.0:1788917004.286775:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83e480 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d8 expref: 7 pid: 8068 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.286794:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83e480 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d8 expref: 7 pid: 8068 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788917004.286802:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a6e3719a300 00000100:00100000:3.0:1788917004.286836:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:3.0:1788917004.286846:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3719a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2373:x1875815113511424:12345-192.168.202.40@tcp:4:lfs.0 00000100:00100000:3.0:1788917004.287353:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3719a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:2373:x1875815113511424:12345-192.168.202.40@tcp:4:lfs.0 Request processed in 507us (746us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788917004.287360:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00002000:00100000:3.0:1788917004.287367:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9a6e3719a300 x1875815113511424/t4294967308(0) o4->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:385/0 lens 504/448 e 0 to 0 dl 1788917015 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788917004.287374:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e3719a300 with x1875815113511424 ext(0->8) 00010000:00010000:3.0:1788917004.287380:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83e480 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d8 expref: 9 pid: 8068 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.287414:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83e480 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d8 expref: 9 pid: 8068 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788917004.287422:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a6e3719a300 00000100:00100000:0.0:1788917004.288368:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f379180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1875815140763264:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788917004.288411:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83e4bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917004.291479:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917004.291550:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113511552 00000100:00100000:2.0:1788917004.291560:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113511552 00010000:00010000:2.0:1788917004.291599:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83e480 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d8 expref: 9 pid: 8068 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917004.291644:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:2.0:1788917004.291667:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37198a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:2371:x1875815113511552:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788917004.291681:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788917004.291702:0:5778:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788917004.291705:0:5778:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788917003 00002000:00010000:2.0:1788917004.291707:0:5778:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788917003 00002000:00010000:2.0:1788917004.291709:0:5778:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788917003 00010000:00010000:2.0:1788917004.291715:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83e480 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d8 expref: 9 pid: 8068 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.291729:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83e480 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d8 expref: 9 pid: 8068 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.291753:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83e480 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7d8 expref: 9 pid: 8068 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.291770:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788917004.291775:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788917004.291781:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83e4bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.291792:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83e4bf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.291827:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788917004.291903:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37198a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2371:x1875815113511552:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 230us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917004.291912:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 77 00010000:00010000:0.0:1788917004.291992:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83e4bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.292003:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83e4bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.292027:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83e4bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.292035:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83e4bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.292049:0:6593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83e4bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.292057:0:6593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3e00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788917004.292061:0:6593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83e4bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.292070:0:6593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83e4bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.292081:0:6593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83e4bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.292088:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372d691e/0x51de7f756a83e4bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917004.292136:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a17df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2373:x1875815113511296:12345-192.168.202.40@tcp:1:lfs.0 Request processed in 9334us (9855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917004.292196:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:1.0:1788917004.296274:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917004.296413:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113511808 00000100:00100000:0.0:1788917004.296423:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113511808 00000100:00100000:0.0:1788917004.296520:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:0.0:1788917004.296531:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e08cffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+43:11613:x1875815113511808:12345-192.168.202.40@tcp:35:lfs.0 00000004:00010000:0.0:1788917004.296601:0:5796:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e4b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7ed expref: 43 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788917004.296908:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1788917004.296956:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788917004.297309:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1788917004.297365:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e4c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.297381:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e46b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7ca expref: 47 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.297390:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e4c6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.297438:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e46b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7ca expref: 47 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.297452:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e46b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7ca expref: 47 pid: 5792 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917004.297468:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f379180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5796:1875815140763392:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917004.297558:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e02b9bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788917004.299829:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917004.299946:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113511936 00000100:00100000:2.0:1788917004.299966:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113511936 00010000:00010000:2.0:1788917004.300109:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e46b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7ca expref: 48 pid: 5792 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917004.300235:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:2.0:1788917004.300245:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3719b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+48:2373:x1875815113511936:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788917004.300261:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917004.300268:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e46b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7ca expref: 48 pid: 5792 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.300281:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e46b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7ca expref: 48 pid: 5792 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.300303:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee800) 00010000:00010000:2.0:1788917004.300309:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e4c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.300318:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.300327:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e4c6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.300345:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788917004.300410:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3719b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+48:2373:x1875815113511936:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 166us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917004.300418:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 78 00010000:00010000:0.0:1788917004.300570:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e46b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7ca expref: 47 pid: 5792 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917004.300588:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f379180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5796:1875815140763392:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788917004.300611:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.300638:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.300644:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788917004.300835:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788917004.301683:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788917004.301904:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f379180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5796:1875815140763520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788917004.301964:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917004.301995:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e02b9b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788917004.302020:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140763520 00000100:00100000:0.0:1788917004.302025:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140763520 00000100:00100000:0.0:1788917004.302072:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788917004.302079:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5796:x1875815140763520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788917004.302143:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5796:x1875815140763520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 65us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917004.302167:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788917004.302185:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917004.302208:0:5796:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1788917004.302213:0:5796:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1788917004.302231:0:5796:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6e2d0f5f80, transno 4294967307 00000100:00100000:0.0:1788917004.302249:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f379180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5796:1875815140763520:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788917004.302693:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1788917004.303412:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f379180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5796:1875815140763648:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788917004.303458:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917004.303502:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e02b9bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788917004.303695:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140763648 00000100:00100000:3.0:1788917004.303702:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140763648 00000100:00100000:3.0:1788917004.303788:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788917004.303798:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f37bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5796:x1875815140763648:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788917004.304010:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f37bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5796:x1875815140763648:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 213us (550us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788917004.304018:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788917004.304045:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f379180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5796:1875815140763648:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788917004.304100:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788917004.304142:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917004.304169:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e4c6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917004.304176:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e4c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917004.304182:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917004.304187:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e4c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917004.304196:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e4c6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917004.304214:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee800) 00010000:00010000:1.0:1788917004.304217:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788917004.304221:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e4c6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917004.304227:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e4c6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788917004.304421:0:5796:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788917004.304509:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1788917004.304520:0:5796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400336373151ns, next at 401336371424ns, rc = 0 00000001:00080000:1.0:1788917004.304526:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788917004.304556:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee800) 00010000:00010000:1.0:1788917004.304559:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788917004.304566:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e4b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7ed expref: 51 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917004.304659:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e08cffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+50:11613:x1875815113511808:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 8130us (8394us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788917004.304668:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000020:00080000:1.0:1788917004.304672:0:5796:0:(tgt_main.c:816:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788917004.306490:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917004.306572:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113512064 00000100:00100000:3.0:1788917004.306582:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113512064 00000100:00100000:3.0:1788917004.306645:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 203 00000100:00100000:3.0:1788917004.306654:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+50:11613:x1875815113512064:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788917004.306677:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917004.306698:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e4cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f7f4 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.306772:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e4cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7f4 expref: 51 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.306787:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e4cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7f4 expref: 51 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.306826:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:3.0:1788917004.306829:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788917004.306831:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18fc00, rc 0) 00000100:00100000:3.0:1788917004.306895:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37199c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+51:11613:x1875815113512064:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 241us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917004.306902:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 203 00000100:00100000:2.0:1788917004.309692:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917004.309803:0:11923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113512320 00000100:00100000:0.0:1788917004.309811:0:11923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113512320 00000100:00100000:1.0:1788917004.309882:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:1.0:1788917004.310009:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+51:11613:x1875815113512320:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1788917004.310276:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+52:11613:x1875815113512320:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 384us (590us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788917004.310285:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:1.0:1788917004.380434:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917004.380536:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113512448 00000100:00100000:2.0:1788917004.380546:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113512448 00000100:00100000:2.0:1788917004.380613:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 204 00000100:00100000:2.0:1788917004.380624:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3719b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+52:11623:x1875815113512448:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:2.0:1788917004.380730:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e4d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.380750:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e4d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.380760:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e4d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.380777:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e4db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.380784:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e4db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.380791:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e4db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.380913:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e4e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.380922:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.380929:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788917004.380974:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381015:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e4d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381022:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e4d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381029:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381036:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917004.381040:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e4d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381047:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e4d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381060:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:2.0:1788917004.381063:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917004.381066:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e4d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381072:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e4d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381088:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e4db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381094:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e4db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381100:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e4db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381110:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00030000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917004.381114:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e4db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381120:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e4db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381127:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e02f3c800) 00010000:00010000:2.0:1788917004.381130:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917004.381132:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e4db lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381138:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e4db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381435:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e4e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381443:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e4e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381449:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e4e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381454:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00030e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917004.381457:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e4e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381463:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e4e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381482:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:2.0:1788917004.381485:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917004.381488:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e4e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.381493:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030e00/0x51de7f756a83e4e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917004.381577:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3719b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+52:11623:x1875815113512448:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 954us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917004.381586:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 204 00000100:00100000:2.0:1788917004.417803:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917004.418115:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113512704 00000100:00100000:3.0:1788917004.418126:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113512704 00000100:00100000:3.0:1788917004.418247:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 205 00000100:00100000:3.0:1788917004.418259:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+52:11626:x1875815113512704:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788917004.418284:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917004.418306:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e4e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f7fb expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.418388:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e4f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.418431:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e4f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.418445:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e4f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.418463:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e4f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.418470:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.418509:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.418646:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e4fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.418655:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e4fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.418663:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e4fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917004.418673:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788917004.418797:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e4f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.418805:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e4f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.418813:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e4f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.418819:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917004.418823:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e4f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.418831:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e4f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.418845:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:3.0:1788917004.418848:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917004.418860:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e4f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.418867:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e4f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.418882:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.418888:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e4f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.419389:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e4f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.419405:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917004.419408:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e4f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.419414:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e4f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.419422:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e02cee300) 00010000:00010000:3.0:1788917004.419424:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917004.419427:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e4f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.419432:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e4f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.419592:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e4e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7fb expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.419620:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e4fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7fb expref: 54 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.419627:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:3.0:1788917004.419630:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788917004.419633:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e800, rc 0) 00000100:00100000:3.0:1788917004.419794:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+54:11626:x1875815113512704:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1536us (2000us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788917004.419804:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 205 00000100:00100000:0.0:1788917004.424187:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917004.424279:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113512832 00000100:00100000:3.0:1788917004.424290:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113512832 00000100:00100000:3.0:1788917004.424358:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 206 00000100:00100000:3.0:1788917004.424369:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f37a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+54:11626:x1875815113512832:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:3.0:1788917004.424452:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e50c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.424470:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e50c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.424493:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e50c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.424522:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e50c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.424530:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e50c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.424555:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e50c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.424561:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18ea00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917004.424566:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e50c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.424573:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e50c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.424585:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:3.0:1788917004.424588:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788917004.424592:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e50c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.424598:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e50c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917004.424686:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f37a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+54:11626:x1875815113512832:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 318us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917004.424694:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 206 00000100:00100000:1.0:1788917004.430288:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917004.430384:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113513088 00000100:00100000:0.0:1788917004.430404:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113513088 00000100:00100000:0.0:1788917004.430471:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:0.0:1788917004.430482:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3719a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+54:11626:x1875815113513088:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1788917004.430746:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3719a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:11626:x1875815113513088:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 264us (467us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788917004.430755:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:2.0:1788917004.501024:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917004.502318:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113513344 00000100:00100000:0.0:1788917004.502406:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113513344 00000100:00100000:2.0:1788917004.502740:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 207 00000100:00100000:2.0:1788917004.502752:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:11636:x1875815113513344:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1788917004.502779:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917004.502783:0:8069:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788917004.502812:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83e48e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7df expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.502835:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:2.0:1788917004.502840:0:8069:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788917004.502859:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e513 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f802 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.502983:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e51a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.503029:0:8069:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e4fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7fb expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.503047:0:8069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e51a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.503082:0:8069:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e4fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7fb expref: 55 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.503095:0:8069:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e4fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7fb expref: 55 pid: 5792 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917004.503110:0:8069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d155f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140763776:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788917004.503262:0:8069:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3730ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788917004.507938:0:8069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d155f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140763776:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788917004.507975:0:8069:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e51a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917004.508753:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917004.508830:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113513472 00000100:00100000:2.0:1788917004.508838:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113513472 00010000:00010000:2.0:1788917004.508879:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e4fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7fb expref: 56 pid: 5792 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917004.508930:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:2.0:1788917004.508943:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f378a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+56:2373:x1875815113513472:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788917004.508960:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917004.508983:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e4fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7fb expref: 56 pid: 5792 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.509006:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e4fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7fb expref: 56 pid: 5792 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.509185:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83e4fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7fb expref: 56 pid: 5792 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.509203:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:2.0:1788917004.509209:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e51a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.509218:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e51a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.509225:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e51a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.509312:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788917004.509418:0:8069:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e51a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.509426:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e51a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917004.509448:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788917004.509611:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00030000/0x51de7f756a83e513 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f802 expref: 57 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.509631:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e51a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f802 expref: 56 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.509639:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:0.0:1788917004.509642:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788917004.509652:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031200, rc 0) 00000100:00100000:0.0:1788917004.509707:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+56:11636:x1875815113513344:12345-192.168.202.40@tcp:101:bash.0 Request processed in 6957us (8693us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788917004.509716:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 207 00000100:00100000:2.0:1788917004.509787:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f378a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:2373:x1875815113513472:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 845us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917004.509794:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:0.0:1788917004.516712:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917004.516810:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113513728 00000100:00100000:3.0:1788917004.516821:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113513728 00000100:00100000:3.0:1788917004.516882:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 208 00000100:00100000:3.0:1788917004.516893:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+55:11636:x1875815113513728:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:3.0:1788917004.517237:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e528 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.517255:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e528 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.517280:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e528 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788917004.517331:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1788917004.517353:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000378d5c7b reply state 000000008ffbc03d transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e528 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917004.517362:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788917004.517768:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+58:11636:x1875815113513728:12345-192.168.202.40@tcp:36:bash.0 Request processed in 874us (1062us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788917004.517779:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 208 00000020:00080000:3.0:1788917004.517785:0:5794:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788917004.519279:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e528 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.519294:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e528 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.519301:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e528 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.519325:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917004.519330:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e528 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.519337:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e528 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.519352:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:2.0:1788917004.519355:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917004.519359:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e528 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.519365:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e528 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917004.523752:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917004.523813:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113513856 00000100:00100000:3.0:1788917004.524310:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113513856 00000100:00100000:3.0:1788917004.524373:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 209 00000100:00100000:3.0:1788917004.524386:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+57:11636:x1875815113513856:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1788917004.524426:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917004.524451:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e52f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f809 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.524569:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e536 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.524584:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e51a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f802 expref: 58 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.524593:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e536 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.524641:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e51a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f802 expref: 58 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.524656:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e51a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f802 expref: 58 pid: 8069 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917004.524672:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1875815140763904:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788917004.525202:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e0b456000 going to sleep for 11 seconds 00000100:00100000:3.0:1788917004.529045:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1875815140763904:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788917004.529077:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e536 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917004.531575:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917004.532028:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113513984 00000100:00100000:3.0:1788917004.532047:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113513984 00010000:00010000:3.0:1788917004.532087:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e51a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f802 expref: 59 pid: 8069 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917004.532129:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:3.0:1788917004.532138:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f37b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+59:2373:x1875815113513984:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917004.532188:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917004.532196:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e51a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f802 expref: 59 pid: 8069 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.532210:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e51a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f802 expref: 59 pid: 8069 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.532261:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031200/0x51de7f756a83e51a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f802 expref: 59 pid: 8069 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.532280:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:3.0:1788917004.532285:0:6606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e536 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.532295:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.532302:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e536 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.532564:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917004.532671:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f37b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+58:2373:x1875815113513984:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 532us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917004.532679:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 80 00010000:00010000:0.0:1788917004.534179:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.534191:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917004.534236:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788917004.534239:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788917004.534256:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e536 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.534285:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e52f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f809 expref: 58 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.534301:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e536 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f809 expref: 57 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.534307:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:0.0:1788917004.534309:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788917004.534312:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e000, rc 0) 00000100:00100000:0.0:1788917004.534368:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+57:11636:x1875815113513856:12345-192.168.202.40@tcp:101:bash.0 Request processed in 9985us (10629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917004.534374:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 209 00000100:00100000:1.0:1788917004.548661:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917004.548762:0:11923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113514240 00000100:00100000:0.0:1788917004.548773:0:11923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113514240 00000100:00100000:0.0:1788917004.548874:0:11923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:0.0:1788917004.548885:0:11923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+57:11636:x1875815113514240:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:0.0:1788917004.549189:0:11923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+58:11636:x1875815113514240:12345-192.168.202.40@tcp:35:bash.0 Request processed in 302us (535us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788917004.549197:0:11923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:1.0:1788917004.606116:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917004.606299:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113514368 00000100:00100000:0.0:1788917004.606310:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113514368 00000100:00100000:0.0:1788917004.606386:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 210 00000100:00100000:0.0:1788917004.606410:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+58:11642:x1875815113514368:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1788917004.606438:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917004.606463:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e53d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f810 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.606536:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e544 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.606552:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.606564:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917004.606624:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1788917004.606628:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788917004.606668:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e544 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.606697:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e53d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f810 expref: 60 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.606733:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e544 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f810 expref: 59 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.606743:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:0.0:1788917004.606747:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788917004.606750:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3a00, rc 0) 00000100:00100000:0.0:1788917004.606824:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+59:11642:x1875815113514368:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 429us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917004.606833:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 210 00000100:00100000:2.0:1788917004.614427:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917004.614503:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113514496 00000100:00100000:0.0:1788917004.614513:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113514496 00000100:00100000:0.0:1788917004.614582:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 211 00000100:00100000:0.0:1788917004.614593:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+59:11642:x1875815113514496:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1788917004.614615:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917004.614639:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e54b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f817 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.614709:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e552 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.614724:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e552 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.614735:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e552 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.614751:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e559 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.614772:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.614779:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.614885:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e560 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.614894:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.614901:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917004.614938:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788917004.614943:0:8069:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788917004.614960:0:8069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.614973:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.614980:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e552 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.614987:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e552 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.615008:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e552 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.615024:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917004.615029:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e552 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.615045:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e552 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.615057:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:0.0:1788917004.615061:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917004.615066:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e552 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.615071:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e552 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.615085:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.615090:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e559 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.615096:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e559 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.615101:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917004.615103:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e559 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.615118:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e559 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.615137:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e03d86200) 00010000:00010000:0.0:1788917004.615140:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917004.615196:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e559 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.615204:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e559 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.615238:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e54b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f817 expref: 61 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.615735:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f817 expref: 60 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.615745:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:0.0:1788917004.615748:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788917004.615750:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3400, rc 0) 00000100:00100000:0.0:1788917004.615873:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+60:11642:x1875815113514496:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1281us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917004.615881:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 211 00000100:00100000:1.0:1788917004.626479:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917004.626536:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917004.626545:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113514624 00000100:00100000:2.0:1788917004.626556:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113514624 00000100:00100000:2.0:1788917004.626612:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:2.0:1788917004.626620:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e408e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+60:2373:x1875815113514624:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788917004.626634:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917004.626655:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e560 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f817 expref: 60 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.626669:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:2.0:1788917004.626673:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788917004.626719:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e408e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+59:2373:x1875815113514624:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 99us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917004.626737:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:0.0:1788917004.627424:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113514880 00000100:00100000:0.0:1788917004.627432:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113514880 00000100:00100000:0.0:1788917004.627473:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 212 00000100:00100000:0.0:1788917004.627482:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3719b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+59:11642:x1875815113514880:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1788917004.628439:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917004.628464:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e567 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f81e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.628599:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e56e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.628615:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e536 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f809 expref: 60 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.628624:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e56e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.629270:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e536 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f809 expref: 60 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.629287:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e536 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f809 expref: 60 pid: 5792 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917004.629302:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f37a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1875815140764032:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917004.629419:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e02b9b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788917004.635762:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f37a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1875815140764032:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788917004.635794:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e56e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917004.636200:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917004.636373:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113515008 00000100:00100000:3.0:1788917004.636381:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113515008 00010000:00010000:3.0:1788917004.636432:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e536 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f809 expref: 61 pid: 5792 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917004.636470:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:3.0:1788917004.636481:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3719aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+61:2374:x1875815113515008:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917004.636585:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917004.636595:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e536 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f809 expref: 61 pid: 5792 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.636634:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e536 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f809 expref: 61 pid: 5792 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.636728:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e536 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f809 expref: 61 pid: 5792 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.636744:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:3.0:1788917004.636749:0:6606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e56e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.636759:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e56e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.636766:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e56e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.636839:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917004.636910:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3719aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+60:2374:x1875815113515008:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 430us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917004.636919:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 81 00010000:00010000:0.0:1788917004.637419:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e56e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.637430:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e56e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917004.637452:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788917004.637802:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e567 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f81e expref: 61 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.637821:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e56e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f81e expref: 60 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917004.637830:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:0.0:1788917004.637833:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788917004.637836:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3e00, rc 0) 00000100:00100000:0.0:1788917004.637927:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3719b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+60:11642:x1875815113514880:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 10445us (11390us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788917004.637936:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 212 00000100:00100000:1.0:1788917004.643529:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917004.643768:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113515264 00000100:00100000:2.0:1788917004.643779:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113515264 00000100:00100000:2.0:1788917004.643847:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:2.0:1788917004.643857:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37199f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+60:11642:x1875815113515264:12345-192.168.202.40@tcp:103:lfs.0 00010000:00010000:2.0:1788917004.643874:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917004.643900:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e4cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7f4 expref: 60 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917004.643923:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:2.0:1788917004.643928:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788917004.644803:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37199f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+59:11642:x1875815113515264:12345-192.168.202.40@tcp:103:lfs.0 Request processed in 944us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917004.644813:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:1.0:1788917004.650505:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917004.650657:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113515392 00000100:00100000:3.0:1788917004.650667:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113515392 00000100:00100000:3.0:1788917004.650737:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 213 00000100:00100000:3.0:1788917004.650748:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+59:11642:x1875815113515392:12345-192.168.202.40@tcp:58:lfs.0 00010000:00010000:3.0:1788917004.651210:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e57c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.651405:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e57c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.651432:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e57c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788917004.651635:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788917004.652998:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37198000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+59:11642:x1875815113515392:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 2235us (2484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917004.653012:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 213 00000100:00100000:1.0:1788917004.656547:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917004.656646:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113515520 00000100:00100000:3.0:1788917004.656655:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113515520 00000100:00100000:3.0:1788917004.656756:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 214 00000100:00100000:3.0:1788917004.656766:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+59:11642:x1875815113515520:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788917004.656790:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917004.656828:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e583 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f825 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.657182:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e57c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.657194:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e583 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f825 expref: 60 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.657213:0:5794:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e57c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.657225:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e583 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f825 expref: 60 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.657238:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:3.0:1788917004.657253:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788917004.657258:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e583 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f825 expref: 60 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917004.657266:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e600, rc 0) 00000100:00100000:3.0:1788917004.657327:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+60:11642:x1875815113515520:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 562us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917004.657335:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 214 00000100:00100000:1.0:1788917004.831459:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4933373a-b540-4420-bf34-9071e19d7373:3307:1875815140764160:0@lo:400:kworker.0 00000100:00100000:3.0:1788917004.831464:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875815140764416:0@lo:400:kworker.0 00000100:00100000:2.0:1788917004.831545:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140764288:0@lo:400:kworker.0 00000100:00100000:0.0:1788917004.831595:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140764544:0@lo:400:kworker.0 00000100:00100000:3.0:1788917004.831761:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917004.831859:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140764416 00000100:00100000:3.0:1788917004.831867:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140764416 00000100:00080000:3.0:1788917004.831895:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917004.831936:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788917004.831946:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875815140764416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917004.831987:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917004.832024:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875815140764416:12345-0@lo:400:kworker.0 Request processed in 78us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917004.832025:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140764672:0@lo:400:kworker.0 00000100:00100000:3.0:1788917004.832044:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788917004.832086:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875815140764416:0@lo:400:kworker.0 00000100:00100000:3.0:1788917004.832123:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140764160 00000100:00100000:3.0:1788917004.832127:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140764160 00000100:00100000:1.0:1788917004.832142:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917004.832173:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788917004.832182:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3307:x1875815140764160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917004.832211:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140764672 00000100:00100000:1.0:1788917004.832217:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140764672 00000100:00100000:3.0:1788917004.832226:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4933373a-b540-4420-bf34-9071e19d7373+19:3307:x1875815140764160:12345-0@lo:400:kworker.0 Request processed in 45us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917004.832234:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788917004.832258:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788917004.832269:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3719ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140764672:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788917004.832277:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788917004.832340:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a17f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4933373a-b540-4420-bf34-9071e19d7373:3307:1875815140764160:0@lo:400:kworker.0 00000100:00100000:2.0:1788917004.832701:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917004.832853:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140764288 00000100:00100000:3.0:1788917004.832858:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140764288 00000100:00100000:3.0:1788917004.832896:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788917004.832903:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140764288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917004.832943:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140764288:12345-0@lo:400:kworker.0 Request processed in 40us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917004.832948:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788917004.833245:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3719ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140764672:12345-0@lo:400:kworker.0 Request processed in 977us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917004.833253:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788917004.834036:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140764672:0@lo:400:kworker.0 00000100:00100000:2.0:1788917004.834633:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140764288:0@lo:400:kworker.0 00000100:00100000:0.0:1788917004.838012:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917004.838179:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140764544 00000100:00100000:3.0:1788917004.838189:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140764544 00000100:00100000:3.0:1788917004.838358:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788917004.838369:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140764544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917004.838456:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140764544:12345-0@lo:400:kworker.0 Request processed in 89us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917004.838464:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1788917004.838515:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917004.838551:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140764544:0@lo:400:kworker.0 00010000:00010000:0.0:1788917005.087443:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788917005.343467:0:7871:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 401375317875ns, next at 402375314686ns, rc = 0 00000100:00100000:3.0:1788917005.343539:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788917005.343562:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140764800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917005.343656:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917005.343800:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140764800 00000100:00100000:1.0:1788917005.343809:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140764800 00000100:00100000:1.0:1788917005.343878:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788917005.343888:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140764800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788917005.343925:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917005.344142:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140764800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 254us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917005.344171:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788917005.344346:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140764800:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788917005.407453:0:11537:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788917005.407464:0:11537:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917005.407518:0:11537:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:0.0:1788917005.407525:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788917005.407669:0:11537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f379500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1875815140764928:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788917005.407780:0:11537:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e02b9b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788917005.410482:0:11537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f379500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1875815140764928:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788917005.410961:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917005.414118:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113515648 00000100:00100000:3.0:1788917005.414135:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113515648 00000100:00100000:3.0:1788917005.414234:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 215 00000100:00100000:3.0:1788917005.414246:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+60:11644:x1875815113515648:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788917005.414280:0:5793:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788917005.414398:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+60:11644:x1875815113515648:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 155us (3439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917005.414420:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 215 00000100:00100000:1.0:1788917005.426229:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917005.426329:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113515776 00000100:00100000:3.0:1788917005.426341:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113515776 00000100:00100000:3.0:1788917005.426405:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 216 00000100:00100000:3.0:1788917005.426417:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+60:11644:x1875815113515776:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788917005.426500:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e58a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426518:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e58a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426530:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e58a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426544:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e591 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426551:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e591 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426558:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e591 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426580:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e598 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426589:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426595:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917005.426649:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788917005.426654:0:8069:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788917005.426667:0:8069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426677:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e58a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426683:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e58a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426690:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e58a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426695:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917005.426699:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e58a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426705:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e58a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426717:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:3.0:1788917005.426720:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917005.426724:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e58a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426731:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e58a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426743:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e591 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426759:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e591 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426765:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e591 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426770:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917005.426773:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e591 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426779:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e591 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426786:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9a6e02cee800) 00010000:00010000:3.0:1788917005.426789:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917005.426791:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e591 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426797:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e591 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426816:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426822:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e598 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426826:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426830:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917005.426841:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426849:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e598 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426857:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:3.0:1788917005.426860:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917005.426862:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e598 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.426869:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e598 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917005.426951:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+60:11644:x1875815113515776:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 Request processed in 536us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917005.426959:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 216 00000100:00100000:1.0:1788917005.436094:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917005.436351:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113516032 00000100:00100000:3.0:1788917005.436361:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113516032 00000100:00100000:3.0:1788917005.436511:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 217 00000100:00100000:3.0:1788917005.436522:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+60:11644:x1875815113516032:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788917005.436547:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917005.436572:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e59f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f82c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.436677:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.436693:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.436723:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917005.436735:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788917005.436837:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.436845:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.436866:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.436873:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18ea00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917005.436877:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.436884:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.436896:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:3.0:1788917005.436899:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788917005.436904:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.437041:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.437083:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e59f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f82c expref: 62 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.437106:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:3.0:1788917005.437109:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788917005.437113:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e59f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f82c expref: 62 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.437124:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18fc00, rc 0) 00000100:00100000:3.0:1788917005.437535:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+61:11644:x1875815113516032:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 1012us (1451us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1788917005.437543:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 217 00000100:00100000:1.0:1788917005.444582:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917005.444678:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113516160 00000100:00100000:3.0:1788917005.444689:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113516160 00000100:00100000:3.0:1788917005.444753:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 218 00000100:00100000:3.0:1788917005.444764:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3719b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+61:11644:x1875815113516160:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788917005.444804:0:8069:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788917005.445005:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3719b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+61:11644:x1875815113516160:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 243us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917005.445014:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 218 00000100:00100000:1.0:1788917005.455248:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917005.455444:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113516416 00000100:00100000:2.0:1788917005.455455:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113516416 00000100:00100000:2.0:1788917005.455519:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 219 00000100:00100000:2.0:1788917005.455530:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+61:11644:x1875815113516416:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788917005.455554:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917005.455571:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788917005.455599:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3a00/0x51de7f756a83e544 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f810 expref: 61 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917005.455619:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:2.0:1788917005.455624:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788917005.455638:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e5b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f833 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788917005.457427:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1788917005.457656:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e5bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.457682:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e5bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.457693:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e5bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.457757:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031600/0x51de7f756a83e5b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f833 expref: 63 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.457778:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e5bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f833 expref: 62 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.457787:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6e03d86200) 00010000:00010000:0.0:1788917005.457790:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788917005.457793:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2800, rc 0) 00000100:00100000:0.0:1788917005.457867:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+62:11644:x1875815113516416:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 2339us (2629us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788917005.457876:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 219 00000100:00100000:2.0:1788917005.462679:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917005.462764:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113516672 00000100:00100000:3.0:1788917005.462775:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113516672 00000100:00100000:3.0:1788917005.462832:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 220 00000100:00100000:3.0:1788917005.462842:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+62:11644:x1875815113516672:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788917005.462922:0:8069:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917005.462951:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e5bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f833 expref: 62 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.462999:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6e03d86200) 00010000:00010000:3.0:1788917005.463011:0:8069:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788917005.463033:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.463047:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.463056:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.464419:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xaeea9a5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.464437:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xaeea9a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.464447:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xaeea9a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.464534:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.464542:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5c9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.464549:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.464555:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18fc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917005.464560:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.464582:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.464594:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:3.0:1788917005.464597:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917005.464601:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.464607:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.464622:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xaeea9a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.464628:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaeea9a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.464633:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaeea9a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.464639:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18ea00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917005.464641:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaeea9a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.464647:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaeea9a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.464654:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xaeea9a5e (ffff9a6e02cee800) 00010000:00010000:3.0:1788917005.464656:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917005.464659:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xaeea9a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.464674:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xaeea9a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917005.464772:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+61:11644:x1875815113516672:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 1928us (2099us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788917005.464780:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 220 00000100:00100000:2.0:1788917005.469674:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917005.469762:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113516800 00000100:00100000:0.0:1788917005.469774:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113516800 00000100:00100000:0.0:1788917005.469831:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 221 00000100:00100000:0.0:1788917005.469840:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+61:11644:x1875815113516800:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788917005.469866:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917005.469892:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e5d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f83a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.469933:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e5de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.469960:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e5de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.469972:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e5de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.470078:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3000/0x51de7f756a83e5d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f83a expref: 63 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.470095:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e5de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f83a expref: 62 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.470104:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6e03d86d00) 00010000:00010000:0.0:1788917005.470108:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788917005.470111:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3200, rc 0) 00000100:00100000:0.0:1788917005.470198:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+62:11644:x1875815113516800:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 359us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917005.470205:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 221 00000100:00100000:0.0:1788917005.474512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917005.474687:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113517056 00000100:00100000:3.0:1788917005.474704:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113517056 00000100:00100000:3.0:1788917005.474766:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 222 00000100:00100000:3.0:1788917005.474776:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+62:11644:x1875815113517056:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788917005.474873:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.474906:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.474918:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788917005.475235:0:8069:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:3.0:1788917005.475325:0:8069:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000944ac98a reply state 000000004db895a7 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917005.475334:0:8069:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788917005.475508:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+64:11644:x1875815113517056:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 731us (1008us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788917005.475517:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 222 00010000:00010000:0.0:1788917005.481552:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.481572:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.481601:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.481608:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18ea00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917005.481612:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.481620:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.481638:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6e03d86d00) 00010000:00010000:0.0:1788917005.481642:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788917005.481646:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.481653:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83e5e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917005.488417:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917005.488561:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113517184 00000100:00100000:3.0:1788917005.488571:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113517184 00000100:00100000:3.0:1788917005.488673:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 223 00000100:00100000:3.0:1788917005.488686:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+63:11644:x1875815113517184:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788917005.488732:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917005.488756:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f841 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.488820:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f841 expref: 64 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.488837:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f841 expref: 64 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.488857:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6e03d86d00) 00010000:00010000:3.0:1788917005.488859:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788917005.488862:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18fc00, rc 0) 00000100:00100000:3.0:1788917005.488952:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+64:11644:x1875815113517184:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 270us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917005.488957:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 223 00000100:00100000:2.0:1788917005.501721:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917005.501840:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113517312 00000100:00100000:1.0:1788917005.501851:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113517312 00000100:00100000:1.0:1788917005.501940:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:1.0:1788917005.501951:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:2374:x1875815113517312:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788917005.502011:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788917005.502259:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+10:2374:x1875815113517312:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 311us (548us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788917005.502265:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:2.0:1788917005.508853:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917005.508955:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113517568 00000100:00100000:1.0:1788917005.508966:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113517568 00000100:00100000:1.0:1788917005.509042:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:1.0:1788917005.509053:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+64:11644:x1875815113517568:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788917005.509805:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+65:11644:x1875815113517568:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 750us (957us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788917005.509815:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:0.0:1788917005.512961:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917005.513117:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113517824 00000100:00100000:1.0:1788917005.513127:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113517824 00000100:00100000:1.0:1788917005.513286:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 224 00000100:00100000:1.0:1788917005.513298:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f37b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+65:11644:x1875815113517824:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788917005.513423:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f37b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+65:11644:x1875815113517824:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 127us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917005.513432:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 224 00000100:00100000:2.0:1788917005.522809:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917005.522880:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113517952 00000100:00100000:3.0:1788917005.522889:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113517952 00000100:00100000:3.0:1788917005.522937:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 225 00000100:00100000:3.0:1788917005.522947:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+65:11644:x1875815113517952:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788917005.522970:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917005.522988:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e5f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f848 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.523049:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e5fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.523076:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e5fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.523084:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e5fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917005.523114:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788917005.523129:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e5fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.523180:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e5f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f848 expref: 67 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.523195:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e5fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f848 expref: 66 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.523201:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6e03d86d00) 00010000:00010000:3.0:1788917005.523203:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788917005.523206:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f200, rc 0) 00000100:00100000:3.0:1788917005.523249:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+66:11644:x1875815113517952:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 306us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917005.523253:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 225 00000100:00100000:2.0:1788917005.532281:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917005.532367:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113518080 00000100:00100000:3.0:1788917005.532378:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113518080 00000100:00100000:3.0:1788917005.532454:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:3.0:1788917005.532466:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+10:2374:x1875815113518080:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788917005.532487:0:8068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917005.532525:0:8068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e601 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f84f expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788917005.532554:0:8068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0b50c, blocks: 0x1 00010000:00010000:3.0:1788917005.532572:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1788917005.532576:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788917005.532583:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e601 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f84f expref: 11 pid: 8068 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.532596:0:8068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e601 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f84f expref: 11 pid: 8068 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.532606:0:8068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f600, rc 0) 00000100:00100000:3.0:1788917005.532653:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36ef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+11:2374:x1875815113518080:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 192us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917005.532659:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:1.0:1788917005.540671:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917005.540831:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113518336 00000100:00100000:0.0:1788917005.540842:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113518336 00000100:00100000:0.0:1788917005.541116:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 226 00000100:00100000:0.0:1788917005.541128:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+66:11644:x1875815113518336:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788917005.541276:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+66:11644:x1875815113518336:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 150us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917005.541284:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 226 00000100:00100000:2.0:1788917005.544684:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917005.544834:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113518464 00000100:00100000:1.0:1788917005.544844:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113518464 00000100:00100000:1.0:1788917005.544903:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:1.0:1788917005.544931:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e36ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+11:11644:x1875815113518464:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788917005.544954:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788917005.544975:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83e608 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f856 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.545288:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e601 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f84f expref: 12 pid: 8068 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.545299:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917005.545303:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917005.545310:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83e608 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f856 expref: 12 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.545367:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e601 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f84f expref: 12 pid: 8068 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.545383:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e601 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f84f expref: 12 pid: 8068 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917005.545412:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a680a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6592:1875815140765056:192.168.202.40@tcp:104: 00000100:00100000:1.0:1788917005.545611:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cda780 going to sleep for 11 seconds 00000100:00100000:1.0:1788917005.556009:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a680a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6592:1875815140765056:192.168.202.40@tcp:104: 00010000:00010000:1.0:1788917005.556055:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83e608 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f856 expref: 12 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.556102:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeaaa00, rc 0) 00000100:00100000:1.0:1788917005.556234:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e36ef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+12:11644:x1875815113518464:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 11306us (11560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917005.556243:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:0.0:1788917005.558995:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917005.559539:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113518592 00000100:00100000:3.0:1788917005.559549:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113518592 00010000:00010000:3.0:1788917005.559595:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e601 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f84f expref: 12 pid: 8068 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917005.559644:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00100000:3.0:1788917005.559654:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f37aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+12:2373:x1875815113518592:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917005.559671:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917005.559695:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e601 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f84f expref: 12 pid: 8068 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.559731:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e601 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f84f expref: 12 pid: 8068 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.559754:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e601 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f84f expref: 12 pid: 8068 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.559774:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788917005.559779:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788917005.559787:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83e608 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f856 expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.559797:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83e608 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f856 expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.559836:0:5777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83e608 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f856 expref: 11 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917005.559852:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5777:1875815140765184:192.168.202.40@tcp:105: 00000100:00100000:3.0:1788917005.559950:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e0b456480 going to sleep for 11 seconds 00000100:00100000:3.0:1788917005.566973:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37134700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5777:1875815140765184:192.168.202.40@tcp:105: 00000100:00100000:0.0:1788917005.567779:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1788917005.568016:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917005.568121:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f37aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+11:2373:x1875815113518592:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 8465us (9139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917005.568133:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00100000:2.0:1788917005.568358:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113518720 00000100:00100000:2.0:1788917005.568367:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113518720 00002000:00100000:2.0:1788917005.568959:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9a6e3f379f80 x1875815113518720/t0(0) o4->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:386/0 lens 504/0 e 0 to 0 dl 1788917016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788917005.568971:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e3f379f80 with x1875815113518720 ext(0->12) 00002000:00010000:2.0:1788917005.568978:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6e3f379f80 00000100:00100000:2.0:1788917005.569141:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:2.0:1788917005.569168:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+11:2373:x1875815113518720:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788917005.569693:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+13:2373:x1875815113518720:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 Request processed in 526us (1914us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788917005.569822:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00002000:00100000:2.0:1788917005.569835:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9a6e3f379f80 x1875815113518720/t4294967320(0) o4->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:386/0 lens 504/448 e 0 to 0 dl 1788917016 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788917005.569846:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e3f379f80 with x1875815113518720 ext(0->12) 00002000:00010000:2.0:1788917005.569850:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6e3f379f80 00000100:00100000:0.0:1788917005.572655:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917005.572736:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113518848 00000100:00100000:3.0:1788917005.572747:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113518848 00000100:00100000:3.0:1788917005.572809:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 227 00000100:00100000:3.0:1788917005.572820:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+66:11644:x1875815113518848:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788917005.615877:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000020:00080000:2.0:1788917005.615903:0:5814:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6e02b9b000 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788917005.615908:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e3a18cc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e02b9b540 00000020:00080000:2.0:1788917005.615912:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e3a18c300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e3f2c0c00 00000020:00080000:2.0:1788917005.615964:0:5814:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6e3c5f9480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788917005.615968:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e3a18c100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e3c5f9e40 00000020:00080000:2.0:1788917005.615971:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e3a18c900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e2d195c00 00000020:00080000:1.0:1788917005.616088:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 4 00000020:00080000:1.0:1788917005.616297:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:2.0:1788917005.616453:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1788917005.616463:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788917005.616486:0:5814:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:2.0:1788917005.616501:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:2.0:1788917005.616550:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:3.0:1788917005.616885:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788917005.616906:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140765440:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788917005.616976:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917005.617136:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140765440 00000100:00100000:3.0:1788917005.617143:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140765440 00000100:00100000:3.0:1788917005.617219:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788917005.617229:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140765440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788917005.617256:0:8068:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1788917005.617285:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e60f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.617306:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e3d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7b5 expref: 12 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.617316:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788917005.617320:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788917005.617325:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e60f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.617353:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e3d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7b5 expref: 12 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.617367:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e3d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7b5 expref: 12 pid: 6590 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917005.617408:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8068:1875815140765568:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788917005.617477:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e0b456480 going to sleep for 11 seconds 00000100:00100000:2.0:1788917005.617837:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140765312:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788917005.617888:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917005.617973:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140765312 00000100:00100000:1.0:1788917005.617978:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140765312 00000100:00100000:1.0:1788917005.618025:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788917005.618033:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e371af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140765312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788917005.618048:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1788917005.618077:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa0b50b, atime: 0x6aa0b50b, ctime: 0x6aa0b50b, blocks: 0x1 00010000:00010000:1.0:1788917005.618084:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e616 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.618093:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=401s v=(0 0) 00010000:00010000:1.0:1788917005.618097:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917005.618102:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e616 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.618117:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e616 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.618127:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e616 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.618164:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e616 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.618180:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788917005.618675:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e371af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1875815140765312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 642us (786us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788917005.618684:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:2.0:1788917005.618845:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788917005.618851:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e616 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917005.618860:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaac00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788917005.618864:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e616 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917005.618885:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e616 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917005.618903:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e616 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917005.618911:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e616 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917005.618931:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917005.618934:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917005.618935:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788917005.618969:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6e3a680a80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788917005.618975:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140765312:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788917005.619716:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:11644:x1875815113518848:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 Request processed in 46894us (47068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917005.619726:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 227 00000100:00100000:3.0:1788917005.621466:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8068:1875815140765568:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788917005.621494:0:8068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e60f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917005.622713:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917005.622836:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917005.623353:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113519104 00000100:00100000:2.0:1788917005.623362:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113519104 00000100:00100000:2.0:1788917005.623426:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:2.0:1788917005.623436:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3b1cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+13:2374:x1875815113519104:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788917005.625594:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113518976 00000100:00100000:3.0:1788917005.625606:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113518976 00010000:00010000:3.0:1788917005.625667:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e3d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7b5 expref: 14 pid: 6590 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917005.625717:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:3.0:1788917005.625726:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a683800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+14:2372:x1875815113518976:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917005.625740:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917005.625747:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e3d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7b5 expref: 14 pid: 6590 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.625762:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e3d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7b5 expref: 14 pid: 6590 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.625786:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e3d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f7b5 expref: 14 pid: 6590 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.625820:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788917005.625826:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788917005.625832:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e60f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.625845:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e60f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.625872:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917005.625940:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a683800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+13:2372:x1875815113518976:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 214us (3242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917005.625949:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 83 00010000:00010000:3.0:1788917005.625977:0:8068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e60f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.626001:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e60f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.626012:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e60f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.626021:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e60f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.626038:0:8068:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788917005.626615:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1875815140765440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9387us (9638us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788917005.626624:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1788917005.626645:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917005.626652:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e60f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.626661:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f600 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917005.626666:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e60f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.626676:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e60f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.626688:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e60f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.626695:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b8e991e/0x51de7f756a83e60f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.626713:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917005.626715:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917005.626717:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788917005.626751:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6e37134700/2, rc 0, transno 4294967321 00000100:00100000:3.0:1788917005.626765:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140765440:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788917005.654662:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3b1cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+12:2374:x1875815113519104:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 Request processed in 31215us (31813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917005.654677:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00000001:00080000:1.0:1788917005.655474:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:1.0:1788917005.655494:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:1.0:1788917005.655500:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:1.0:1788917005.657091:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917005.657224:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113519360 00000100:00100000:0.0:1788917005.657235:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113519360 00000100:00100000:0.0:1788917005.657292:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 228 00000100:00100000:0.0:1788917005.657303:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:11644:x1875815113519360:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788917005.657360:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917005.657398:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83e5fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f848 expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.657419:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6e03d86d00) 00010000:00010000:0.0:1788917005.657424:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788917005.657456:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e61d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.657470:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e61d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.657480:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e61d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788917005.657825:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000751e0158 reply state 00000000800bcd4e transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e61d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917005.657835:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788917005.657949:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+21:11644:x1875815113519360:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 647us (865us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788917005.657957:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 228 00000100:00100000:0.0:1788917005.659740:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917005.659813:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113519488 00000100:00100000:1.0:1788917005.659823:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113519488 00000100:00100000:1.0:1788917005.659872:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:1.0:1788917005.659882:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113519488:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788917005.660071:0:6590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788917005.660074:0:6590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788917003 00002000:00010000:1.0:1788917005.660077:0:6590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788917003 00002000:00010000:1.0:1788917005.660079:0:6590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788917004 -> 1788917003 00002000:00010000:1.0:1788917005.660082:0:6590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788917005.660135:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2374:x1875815113519488:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 254us (402us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788917005.660169:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00010000:00010000:2.0:1788917005.660310:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e61d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917005.660319:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e61d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917005.660333:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e61d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917005.660340:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917005.660345:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e61d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917005.660353:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e61d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917005.660368:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6e03d86d00) 00010000:00010000:2.0:1788917005.660371:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917005.660376:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e61d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917005.660391:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2200/0x51de7f756a83e61d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917005.661428:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917005.661487:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113519744 00000100:00100000:0.0:1788917005.661495:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113519744 00000100:00100000:0.0:1788917005.661547:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 229 00000100:00100000:0.0:1788917005.661558:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:11644:x1875815113519744:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788917005.661623:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e624 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.661639:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e5de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f83a expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.661649:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e624 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.661685:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e5de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f83a expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.661699:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e5de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f83a expref: 20 pid: 5794 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917005.661714:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f378a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1875815140765696:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917005.661842:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e02b9b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788917005.664981:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f378a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5793:1875815140765696:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788917005.665017:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e624 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917005.665373:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917005.665799:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113519872 00000100:00100000:0.0:1788917005.665807:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113519872 00010000:00010000:0.0:1788917005.665844:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e5de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f83a expref: 21 pid: 5794 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917005.665882:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:0.0:1788917005.665891:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+21:2373:x1875815113519872:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788917005.665907:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917005.665915:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e5de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f83a expref: 21 pid: 5794 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.665928:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e5de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f83a expref: 21 pid: 5794 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.665952:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e5de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f83a expref: 21 pid: 5794 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.665969:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6e03d86d00) 00010000:00010000:0.0:1788917005.665974:0:6606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e624 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.665985:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.665995:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e624 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.666031:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788917005.666102:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:2373:x1875815113519872:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 211us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917005.666110:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 84 00010000:00010000:1.0:1788917005.666468:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.666477:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.666507:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.666514:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e624 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.666520:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e624 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.666526:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917005.666530:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e624 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.666537:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e624 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.666546:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6e03d86d00) 00010000:00010000:1.0:1788917005.666549:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788917005.666552:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e624 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.666559:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3400/0x51de7f756a83e624 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917005.666599:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:11644:x1875815113519744:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 Request processed in 5043us (5175us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788917005.666617:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 229 00000100:00100000:3.0:1788917005.668306:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917005.668446:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113520000 00000100:00100000:0.0:1788917005.668455:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113520000 00000100:00100000:0.0:1788917005.668563:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:0.0:1788917005.668573:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2374:x1875815113520000:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788917005.668619:0:8068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e62b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.668641:0:8068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83e608 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f856 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.668650:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788917005.668655:0:8068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788917005.668660:0:8068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e62b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.668698:0:8068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83e608 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f856 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.668711:0:8068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83e608 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f856 expref: 8 pid: 6592 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917005.668726:0:8068:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f378a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8068:1875815140765824:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917005.668803:0:8068:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e02b9b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788917005.671988:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917005.672067:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113520128 00000100:00100000:3.0:1788917005.672078:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113520128 00010000:00010000:3.0:1788917005.672120:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83e608 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f856 expref: 9 pid: 6592 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917005.672200:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00100000:3.0:1788917005.672210:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e371af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:2373:x1875815113520128:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917005.672226:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917005.672252:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83e608 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f856 expref: 9 pid: 6592 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.672266:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83e608 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f856 expref: 9 pid: 6592 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.672290:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788917005.672295:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788917005.672302:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e62b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.672313:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e62b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.672334:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917005.672382:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e371af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+9:2373:x1875815113520128:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 173us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917005.672400:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 85 00010000:00010000:0.0:1788917005.672816:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83e608 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f856 expref: 8 pid: 6592 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917005.672832:0:8068:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f378a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8068:1875815140765824:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788917005.672853:0:8068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e62b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.672864:0:8068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e62b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.672872:0:8068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e62b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.672896:0:8068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e62b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.672905:0:8068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e62b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.672913:0:8068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e62b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.672921:0:8068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2c00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788917005.672926:0:8068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e62b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.672947:0:8068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e62b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.672960:0:8068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e62b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.672969:0:8068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecafb3e0/0x51de7f756a83e62b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917005.673067:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113520000:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 Request processed in 4495us (4768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917005.673076:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:2.0:1788917005.675431:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917005.675516:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113520384 00000100:00100000:1.0:1788917005.675525:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113520384 00000100:00100000:1.0:1788917005.675576:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 230 00000100:00100000:1.0:1788917005.675587:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e371ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:11644:x1875815113520384:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788917005.675674:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e632 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.675692:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.675703:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.675922:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83e639 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.675933:0:8069:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f841 expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.675940:0:8069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83e639 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.675974:0:8069:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f841 expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.675987:0:8069:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f841 expref: 20 pid: 5794 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917005.676020:0:8069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a683480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140765952:192.168.202.40@tcp:104: 00000100:00100000:1.0:1788917005.676105:0:8069:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cda480 going to sleep for 11 seconds 00000100:00100000:2.0:1788917005.678734:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917005.678833:0:8069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a683480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140765952:192.168.202.40@tcp:104: 00010000:00010000:1.0:1788917005.678860:0:8069:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83e639 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917005.679066:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113520512 00000100:00100000:0.0:1788917005.679074:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113520512 00010000:00010000:0.0:1788917005.679107:0:6606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f841 expref: 21 pid: 5794 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917005.679188:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:0.0:1788917005.679198:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e408e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+21:2373:x1875815113520512:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788917005.679212:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917005.679220:0:6606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f841 expref: 21 pid: 5794 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.679233:0:6606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f841 expref: 21 pid: 5794 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.679277:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83e5ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f841 expref: 21 pid: 5794 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.679293:0:6606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6e03d86d00) 00010000:00010000:0.0:1788917005.679297:0:6606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83e639 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.679305:0:6606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83e639 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.679313:0:6606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83e639 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.679331:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788917005.679378:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e408e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:2373:x1875815113520512:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 181us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917005.679397:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 86 00010000:00010000:1.0:1788917005.679655:0:8069:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83e639 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.679663:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83e639 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788917005.679853:0:8069:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1788917005.680008:0:8069:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1788917005.680052:0:8069:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1788917005.680142:0:8069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a683480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8069:1875815140766080:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788917005.680228:0:8069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917005.680257:0:8069:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cda900 going to sleep for 11 seconds 00000100:00100000:3.0:1788917005.680265:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140766080 00000100:00100000:3.0:1788917005.680272:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140766080 00000100:00100000:3.0:1788917005.680321:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788917005.680330:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8069:x1875815140766080:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788917005.680632:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8069:x1875815140766080:12345-0@lo:1000:mdt00_003.0 Request processed in 302us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917005.680641:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788917005.680697:0:8069:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:1.0:1788917005.680704:0:8069:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:1.0:1788917005.680727:0:8069:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9a6e37134700 x1875815140765440/t4294967321(4294967321) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788917021 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788917005.680739:0:8069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a683480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8069:1875815140766080:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788917005.681273:0:8069:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1788917005.681326:0:8069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a683480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8069:1875815140766208:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788917005.681360:0:8069:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917005.681448:0:8069:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cda480 going to sleep for 11 seconds 00000100:00100000:3.0:1788917005.681538:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140766208 00000100:00100000:3.0:1788917005.681544:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140766208 00000100:00100000:3.0:1788917005.681620:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788917005.681630:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8069:x1875815140766208:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788917005.681838:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8069:x1875815140766208:12345-0@lo:1000:mdt00_003.0 Request processed in 210us (476us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788917005.681845:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788917005.682105:0:8069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a683480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8069:1875815140766208:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788917005.682136:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83e639 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.682172:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83e639 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.682181:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83e639 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.682188:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeabe00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917005.682193:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83e639 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.682200:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83e639 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.682217:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6e03d86d00) 00010000:00010000:1.0:1788917005.682220:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788917005.682224:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83e639 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.682231:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83e639 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.682259:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e57c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.682266:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e57c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.682272:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e57c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.682285:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917005.682288:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e57c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.682293:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e57c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.682301:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:1.0:1788917005.682303:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788917005.682309:0:8069:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e583 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f825 expref: 23 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.682320:0:8069:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e583 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f825 expref: 23 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.682328:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e583 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f825 expref: 23 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.682356:0:8069:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e583 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f825 expref: 23 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917005.682368:0:8069:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a680380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140766336:192.168.202.40@tcp:105: 00000100:00100000:1.0:1788917005.682443:0:8069:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cda480 going to sleep for 11 seconds 00000100:00100000:1.0:1788917005.684890:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917005.684949:0:8069:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a680380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8069:1875815140766336:192.168.202.40@tcp:105: 00010000:00010000:0.0:1788917005.684980:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e57c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917005.685007:0:11923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113520640 00000100:00100000:3.0:1788917005.685015:0:11923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113520640 00010000:00010000:0.0:1788917005.685046:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83e57c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.685079:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e640 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.685095:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e640 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917005.685101:0:11923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:3.0:1788917005.685113:0:11923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+24:11642:x1875815113520640:12345-192.168.202.40@tcp:49:lfs.0 00010000:00010000:0.0:1788917005.685132:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e640 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.685142:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e640 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.685172:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e640 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.685179:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e640 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.685185:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917005.685190:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e640 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.685197:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e640 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.685208:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:0.0:1788917005.685212:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917005.685216:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e640 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.685222:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e640 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.685233:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.685239:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e632 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.685252:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e632 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.685257:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaa600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917005.685260:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e632 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.685266:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e632 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917005.685274:0:11923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+24:11642:x1875815113520640:12345-192.168.202.40@tcp:49:lfs.0 Request processed in 159us (390us total) trans 0 rc 0/0 00010000:00010000:0.0:1788917005.685278:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:0.0:1788917005.685283:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1788917005.685287:0:11923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00010000:00010000:0.0:1788917005.685288:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e632 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917005.685296:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa600/0x51de7f756a83e632 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917005.685780:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e371ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+23:11644:x1875815113520384:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 10193us (10355us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788917005.685799:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 230 00000020:00080000:0.0:1788917005.685804:0:8069:0:(tgt_main.c:816:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788917005.686744:0:11537:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788917005.686753:0:11537:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917005.687418:0:11537:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:2.0:1788917005.687430:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788917005.690289:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917005.690349:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113520896 00000100:00100000:2.0:1788917005.690350:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917005.690360:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113520896 00000100:00100000:3.0:1788917005.690434:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113521152 00000100:00100000:3.0:1788917005.690439:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113521152 00000100:00100000:3.0:1788917005.690496:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 231 00000100:00100000:3.0:1788917005.690507:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e371ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+24:11642:x1875815113521152:12345-192.168.202.40@tcp:58:lfs.0 00000040:00080000:3.0:1788917005.690879:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788917005.690965:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e371ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+24:11642:x1875815113521152:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 459us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917005.690972:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 231 00000100:00100000:1.0:1788917005.691196:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:1.0:1788917005.691205:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e08cfec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+23:11644:x1875815113520896:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788917005.691902:0:5795:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788917005.692007:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1788917005.692049:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83e647 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.692065:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83e647 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.692077:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83e647 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.692085:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83e647 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.692092:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83e647 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.692098:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83e647 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.692653:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788917005.692736:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e08cfec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+25:11644:x1875815113520896:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 1531us (2454us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788917005.692741:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00000020:00080000:1.0:1788917005.692744:0:5795:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788917005.692788:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788917005.692805:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83e647 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917005.692814:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788917005.692819:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83e647 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917005.692828:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83e647 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917005.692842:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a6e1959e600) 00010000:00010000:2.0:1788917005.692846:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788917005.692850:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83e647 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917005.692856:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab200/0x51de7f756a83e647 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917005.692877:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917005.692880:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917005.692892:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917005.726124:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917005.726530:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113521280 00000100:00100000:0.0:1788917005.726541:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113521280 00000100:00100000:1.0:1788917005.726714:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 232 00000100:00100000:1.0:1788917005.726724:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e371ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+25:11646:x1875815113521280:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1788917005.726748:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788917005.726767:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83e64e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f85d expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.726845:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83e655 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.726858:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83e655 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.726870:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83e655 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.726883:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e65c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.726890:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e65c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.726897:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e65c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.727188:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e663 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.727199:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e56e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f81e expref: 26 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.727207:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e663 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.727237:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e56e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f81e expref: 26 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.727260:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e56e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f81e expref: 26 pid: 5793 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917005.727276:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a683100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1875815140766464:192.168.202.40@tcp:104: 00000100:00100000:1.0:1788917005.727356:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cda600 going to sleep for 11 seconds 00000100:00100000:3.0:1788917005.730218:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917005.730303:0:11923:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113521536 00000100:00100000:0.0:1788917005.730312:0:11923:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113521536 00000100:00100000:0.0:1788917005.730373:0:11923:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:0.0:1788917005.730394:0:11923:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+27:5591:x1875815113521536:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788917005.730643:0:11923:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+28:5591:x1875815113521536:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 260us (432us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788917005.730663:0:11923:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:1.0:1788917005.730906:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a683100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5792:1875815140766464:192.168.202.40@tcp:104: 00010000:00010000:1.0:1788917005.730935:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e663 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917005.732274:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917005.732369:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113521664 00000100:00100000:3.0:1788917005.732377:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113521664 00010000:00010000:3.0:1788917005.732511:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e56e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f81e expref: 28 pid: 5793 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917005.732586:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 87 00000100:00100000:3.0:1788917005.732594:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e371af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+28:2374:x1875815113521664:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917005.732607:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917005.732615:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e56e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f81e expref: 28 pid: 5793 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.732626:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e56e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f81e expref: 28 pid: 5793 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.732649:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e56e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f81e expref: 28 pid: 5793 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.732665:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:3.0:1788917005.732670:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e663 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.732680:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.732688:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e663 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917005.732717:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917005.732773:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e371af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+27:2374:x1875815113521664:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 179us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917005.732780:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 87 00010000:00010000:1.0:1788917005.733232:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733240:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788917005.733283:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788917005.733287:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788917005.733306:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733319:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733328:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83e655 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733335:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83e655 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733353:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83e655 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733359:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaa400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917005.733364:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83e655 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733371:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83e655 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733381:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:1.0:1788917005.733393:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788917005.733398:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83e655 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733415:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83e655 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733427:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e65c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733433:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e65c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733439:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e65c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733444:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaac00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917005.733448:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e65c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733464:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e65c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733473:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a6e1959e600) 00010000:00010000:1.0:1788917005.733475:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788917005.733478:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e65c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733484:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e65c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733518:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeabe00/0x51de7f756a83e64e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f85d expref: 27 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733532:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e663 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f85d expref: 26 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917005.733539:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:1.0:1788917005.733541:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788917005.733543:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeaae00, rc 0) 00000100:00100000:1.0:1788917005.733590:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e371ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+26:11646:x1875815113521280:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 6867us (7475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917005.733598:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 232 00000100:00100000:2.0:1788917005.855377:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788917005.855421:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e371aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140766592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788917005.855502:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917005.855587:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140766592 00000100:00100000:2.0:1788917005.855595:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140766592 00000100:00100000:2.0:1788917005.855640:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788917005.855660:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e371adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875815140766592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788917005.855685:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917005.855730:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e371adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875815140766592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917005.855738:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788917005.855806:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e371aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140766592:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788917006.111566:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917006.408627:0:12467:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788917006.408636:0:12467:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917006.408694:0:12467:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:0.0:1788917006.408699:0:12467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788917006.687460:0:11537:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788917006.687470:0:11537:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917006.687515:0:11537:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:2.0:1788917006.687522:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788917006.687662:0:11537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e371aea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1875815140766720:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788917006.687850:0:11537:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e096e3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788917006.692955:0:11537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e371aea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11537:1875815140766720:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788917006.703748:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917006.703853:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113521792 00000100:00100000:1.0:1788917006.703863:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113521792 00000100:00100000:1.0:1788917006.703935:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 233 00000100:00100000:1.0:1788917006.703946:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f37aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+26:11658:x1875815113521792:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788917006.704008:0:5793:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788917006.704129:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f37aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+26:11658:x1875815113521792:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 184us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917006.704136:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 233 00000100:00080000:0.0:1788917006.704669:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917006.722495:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917006.724902:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113522048 00000100:00100000:1.0:1788917006.724915:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113522048 00000100:00100000:1.0:1788917006.725163:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 234 00000100:00100000:1.0:1788917006.725175:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+26:11658:x1875815113522048:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788917006.725196:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788917006.725217:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83e66a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f864 expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917006.725315:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917006.725329:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917006.725340:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788917006.725350:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788917006.725485:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa400/0x51de7f756a83e66a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f864 expref: 29 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917006.725502:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f864 expref: 28 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917006.725529:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:1.0:1788917006.725532:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788917006.725535:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeaac00, rc 0) 00000100:00100000:1.0:1788917006.725599:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+28:11658:x1875815113522048:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 427us (3115us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788917006.725606:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 234 00000100:00100000:2.0:1788917006.728907:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917006.728993:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917006.729027:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917006.729059:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917006.729094:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917006.729135:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113522432 00000100:00100000:3.0:1788917006.729167:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113522432 00000100:00100000:3.0:1788917006.729204:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 292 00000100:00100000:3.0:1788917006.729211:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:2371:x1875815113522432:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917006.729273:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f367f55b-9b55-442e-a009-d3d404e176a2+13:2371:x1875815113522432:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 62us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917006.729278:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 292 00000100:00100000:0.0:1788917006.729524:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113522688 00000100:00100000:0.0:1788917006.729529:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113522688 00000100:00100000:0.0:1788917006.729562:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113522560 00000100:00100000:0.0:1788917006.729565:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113522560 00000100:00100000:0.0:1788917006.729780:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:0.0:1788917006.729789:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e371ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2371:x1875815113522688:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917006.729831:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e371ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2371:x1875815113522688:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 43us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917006.729838:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:0.0:1788917006.729851:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00100000:0.0:1788917006.729857:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e371ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2371:x1875815113522560:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917006.729879:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e371ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2371:x1875815113522560:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917006.729885:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00080000:0.0:1788917006.729904:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917006.735738:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113522304 00000100:00100000:1.0:1788917006.735755:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113522304 00000100:00100000:1.0:1788917006.735930:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113522816 00000100:00100000:1.0:1788917006.735934:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113522816 00000100:00080000:2.0:1788917006.736003:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917006.736043:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00100000:0.0:1788917006.736057:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e371aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2371:x1875815113522816:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917006.736185:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e371aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2371:x1875815113522816:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 132us (7096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917006.736193:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00100000:0.0:1788917006.736215:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 235 00000100:00100000:0.0:1788917006.736222:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e371aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+28:11658:x1875815113522304:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788917006.736295:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e67f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917006.736312:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e67f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917006.736324:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e67f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917006.736541:0:8069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e67f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917006.736549:0:8069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e67f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917006.736556:0:8069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e67f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917006.736562:0:8069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917006.736567:0:8069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e67f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917006.736575:0:8069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e67f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917006.736598:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:0.0:1788917006.736601:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788917006.736606:0:8069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e67f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917006.736612:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3200/0x51de7f756a83e67f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917006.736727:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e371aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:11658:x1875815113522304:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 503us (7829us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788917006.736734:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 235 00000040:00080000:2.0:1788917006.737025:0:11537:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788917006.737030:0:11537:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917006.737566:0:11537:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:2.0:1788917006.737576:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788917006.740971:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917006.741616:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113522944 00000100:00100000:3.0:1788917006.741627:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113522944 00000100:00100000:3.0:1788917006.741706:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:3.0:1788917006.741718:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f37b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:2374:x1875815113522944:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917006.741736:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917006.741765:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaac00/0x51de7f756a83e671 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f864 expref: 29 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917006.741786:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:3.0:1788917006.741791:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917006.741958:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f37b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+28:2374:x1875815113522944:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 242us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917006.741966:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:2.0:1788917006.757825:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917006.757922:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113523200 00000100:00100000:1.0:1788917006.757933:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113523200 00000100:00100000:1.0:1788917006.758001:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:1.0:1788917006.758011:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e371ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+28:11658:x1875815113523200:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788917006.758844:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e371ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:11658:x1875815113523200:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 829us (1024us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788917006.758854:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00010000:00010000:2.0:1788917007.137310:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917008.022440:0:12518:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788917008.022562:0:12518:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917008.022625:0:12518:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:3.0:1788917008.022632:0:12518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788917008.125698:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917008.126024:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113523456 00000100:00100000:3.0:1788917008.126034:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113523456 00000100:00100000:3.0:1788917008.126111:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 236 00000100:00100000:3.0:1788917008.126121:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f37ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+29:11678:x1875815113523456:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788917008.126168:0:8069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917008.126190:0:8069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e686 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f86b expref: -99 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917008.126286:0:8069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e68d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917008.126300:0:8069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e68d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917008.126313:0:8069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e68d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917008.126323:0:8069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788917008.126450:0:8069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e200/0x51de7f756a83e686 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f86b expref: 32 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917008.126467:0:8069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e68d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f86b expref: 31 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917008.126476:0:8069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:3.0:1788917008.126479:0:8069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788917008.126482:0:8069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f600, rc 0) 00000100:00100000:3.0:1788917008.126529:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f37ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:11678:x1875815113523456:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 410us (840us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788917008.126549:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 236 00000100:00080000:0.0:1788917008.126616:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917008.132398:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917008.132510:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113523584 00000100:00100000:3.0:1788917008.132521:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113523584 00000100:00100000:3.0:1788917008.132584:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 237 00000100:00100000:3.0:1788917008.132596:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:11678:x1875815113523584:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:3.0:1788917008.132678:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e69b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917008.132698:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e69b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917008.132712:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e69b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917008.132749:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e69b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917008.132755:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e69b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917008.132762:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e69b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917008.132768:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917008.132774:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e69b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917008.132782:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e69b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917008.132794:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:3.0:1788917008.132814:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788917008.132820:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e69b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917008.132826:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83e69b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917008.132909:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+31:11678:x1875815113523584:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 316us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917008.132917:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 237 00010000:00010000:3.0:1788917008.159403:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917008.182801:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917008.184455:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113523712 00000100:00100000:3.0:1788917008.184470:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113523712 00000100:00100000:3.0:1788917008.184560:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:3.0:1788917008.184570:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e371ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113523712:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:3.0:1788917008.184591:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917008.184614:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f23f8dc2/0x51de7f756a83e6a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f872 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788917008.184642:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa0b50b, atime: 0x6aa0b50b, ctime: 0x6aa0b50b, blocks: 0xb 00010000:00010000:3.0:1788917008.184662:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=404s v=(0 0) 00010000:00010000:3.0:1788917008.184667:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788917008.184677:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f23f8dc2/0x51de7f756a83e6a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f872 expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917008.184695:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f23f8dc2/0x51de7f756a83e6a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f872 expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917008.184727:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f400, rc 0) 00000100:00100000:3.0:1788917008.184795:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e371ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2374:x1875815113523712:12345-192.168.202.40@tcp:101:cat.0 Request processed in 227us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917008.184803:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00080000:3.0:1788917008.184826:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788917008.189611:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917008.194913:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113523840 00000100:00100000:2.0:1788917008.194929:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113523840 00002000:00100000:2.0:1788917008.194988:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9a6e37135c00 x1875815113523840/t0(0) o3->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:389/0 lens 488/0 e 0 to 0 dl 1788917019 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788917008.195001:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e37135c00 with x1875815113523840 ext(0->4095) 00002000:00010000:2.0:1788917008.195007:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6e37135c00 00000100:00100000:2.0:1788917008.195217:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:2.0:1788917008.195227:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2373:x1875815113523840:12345-192.168.202.40@tcp:3:cat.0 00000100:00100000:2.0:1788917008.195465:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+8:2373:x1875815113523840:12345-192.168.202.40@tcp:3:cat.0 Request processed in 238us (5863us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788917008.195475:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00002000:00100000:2.0:1788917008.195483:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9a6e37135c00 x1875815113523840/t0(0) o3->9afe8ff0-67c2-4292-b970-4ecb57096cb4@192.168.202.40@tcp:389/0 lens 488/4536 e 0 to 0 dl 1788917019 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788917008.195492:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e37135c00 with x1875815113523840 ext(0->4095) 00002000:00010000:2.0:1788917008.195496:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6e37135c00 00000001:00080000:3.0:1788917008.454801:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1788917008.454830:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000040:00080000:1.0:1788917008.799437:0:11537:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788917008.799448:0:11537:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917008.799625:0:11537:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788917008.799632:0:11537:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788917009.183797:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917009.951562:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e371afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140766976:0@lo:400:kworker.0 00000100:00100000:2.0:1788917009.951644:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917009.951718:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e371adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140767488:0@lo:400:kworker.0 00000100:00100000:2.0:1788917009.951746:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917009.951781:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788917009.951788:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e371ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140766848:0@lo:400:kworker.0 00000100:00100000:2.0:1788917009.951819:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917009.951843:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e371af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140767360:0@lo:400:kworker.0 00000100:00100000:2.0:1788917009.951882:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917009.951910:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e371ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140767104:0@lo:400:kworker.0 00000100:00100000:2.0:1788917009.951934:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917009.951952:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788917009.951958:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e371aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140767232:0@lo:400:kworker.0 00000100:00100000:2.0:1788917009.951979:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917009.952011:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140767488 00000100:00100000:2.0:1788917009.952019:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140767488 00000100:00100000:2.0:1788917009.952068:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140767232 00000100:00100000:2.0:1788917009.952072:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140767232 00000100:00100000:2.0:1788917009.952096:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788917009.952105:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1875815140767488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917009.952184:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1875815140767488:12345-0@lo:400:kworker.0 Request processed in 81us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917009.952191:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788917009.952206:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788917009.952211:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3641a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140767232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917009.952237:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3641a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140767232:12345-0@lo:400:kworker.0 Request processed in 25us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917009.952242:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788917009.952256:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140766848 00000100:00100000:2.0:1788917009.952259:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140766848 00000100:00100000:2.0:1788917009.952280:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788917009.952286:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140766848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917009.952309:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140766848:12345-0@lo:400:kworker.0 Request processed in 24us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917009.952324:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788917009.952363:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140766976 00000100:00100000:2.0:1788917009.952367:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140766976 00000100:00100000:2.0:1788917009.952387:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140767360 00000100:00100000:2.0:1788917009.952389:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140767360 00000100:00100000:2.0:1788917009.952399:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140767104 00000100:00100000:2.0:1788917009.952401:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140767104 00000100:00100000:2.0:1788917009.952412:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788917009.952417:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e371af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140766976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917009.952443:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e371af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140766976:12345-0@lo:400:kworker.0 Request processed in 26us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917009.952448:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788917009.952456:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788917009.952460:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140767360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917009.952479:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140767360:12345-0@lo:400:kworker.0 Request processed in 19us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917009.952484:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788917009.952492:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788917009.952496:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140767104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917009.952516:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140767104:12345-0@lo:400:kworker.0 Request processed in 19us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917009.952520:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1788917009.952539:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788917009.952543:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788917009.952545:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788917009.952579:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788917009.952585:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1788917009.952608:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6e3a680a80, transno 4294967310 00000100:00100000:2.0:1788917009.952622:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e371aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140767232:0@lo:400:kworker.0 00000100:00100000:2.0:1788917009.952635:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e371ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140767104:0@lo:400:kworker.0 00000100:00100000:2.0:1788917009.952871:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e371ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140766848:0@lo:400:kworker.0 00000100:00100000:2.0:1788917009.952882:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e371af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140767360:0@lo:400:kworker.0 00000100:00100000:2.0:1788917009.952891:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e371afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140766976:0@lo:400:kworker.0 00000100:00100000:2.0:1788917009.952900:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e371adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140767488:0@lo:400:kworker.0 00010000:00010000:3.0:1788917010.207507:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917010.463824:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e371adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140767616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917010.463926:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917010.464073:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140767616 00000100:00100000:3.0:1788917010.464085:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140767616 00000100:00100000:3.0:1788917010.464193:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788917010.464206:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875815140767616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788917010.464258:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000004:00080000:2.0:1788917010.464366:0:7871:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 406496218122ns, next at 407496215392ns, rc = 0 00000100:00100000:3.0:1788917010.468051:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875815140767616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3827us (4105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917010.468067:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788917010.468229:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e371adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140767616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917010.985300:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140767744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917010.985418:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917010.985678:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140767744 00000100:00100000:1.0:1788917010.985703:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140767744 00000100:00100000:1.0:1788917010.985780:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788917010.985791:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140767744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788917010.985837:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917010.985897:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140767744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917010.985906:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788917010.985974:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140767744:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788917011.022534:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:2.0:1788917011.022565:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:2.0:1788917011.022591:0:5814:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6e36cda900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788917011.022597:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e06fdc400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e36cda000 00000020:00080000:2.0:1788917011.022601:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e06fdc700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e36eff000 00000020:00080000:2.0:1788917011.022712:0:5814:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000004:00080000:2.0:1788917011.022721:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000001:00080000:2.0:1788917011.022745:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1788917011.022761:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788917011.023091:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1788917011.023204:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e371afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140767872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788917011.023310:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917011.023421:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140767872 00000100:00100000:2.0:1788917011.023430:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140767872 00000100:00100000:2.0:1788917011.023508:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788917011.023519:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e371af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1875815140767872:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1788917011.023529:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1788917011.024077:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788917011.024083:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788917003 -> 1788917003 00002000:00010000:2.0:1788917011.024085:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1788917003 -> 1788917003 00002000:00010000:2.0:1788917011.024088:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788917003 -> 1788917003 00002000:00010000:2.0:1788917011.024090:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788917011.024191:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e371af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3304:x1875815140767872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 673us (880us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788917011.024200:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000004:00080000:3.0:1788917011.024244:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6e371afb80/2, rc 0, transno 4294967324 00000100:00100000:3.0:1788917011.024252:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e371afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140767872:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1788917011.048554:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:2.0:1788917011.048575:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:1.0:1788917011.231624:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917011.708097:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917011.708730:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113523968 00000100:00100000:2.0:1788917011.708745:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113523968 00000100:00100000:2.0:1788917011.708848:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 238 00000100:00100000:2.0:1788917011.708861:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:11323:x1875815113523968:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1788917011.709002:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917011.709022:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:11323:x1875815113523968:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 Request processed in 163us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917011.709032:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 238 00000100:00100000:3.0:1788917011.713687:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917011.715242:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113524224 00000100:00100000:2.0:1788917011.715261:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113524224 00000100:00100000:2.0:1788917011.715429:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:2.0:1788917011.715442:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+18:11323:x1875815113524224:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788917011.716174:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:11323:x1875815113524224:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 696us (2465us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788917011.716185:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:0.0:1788917011.852853:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917011.852937:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917011.852973:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917011.853024:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917011.853118:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113524608 00000100:00100000:1.0:1788917011.853133:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113524608 00000100:00100000:1.0:1788917011.853256:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113524480 00000100:00100000:1.0:1788917011.853260:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113524480 00000100:00100000:1.0:1788917011.853289:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:1.0:1788917011.853302:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113524608:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917011.853443:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2374:x1875815113524608:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 143us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917011.853451:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:1.0:1788917011.853471:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:1.0:1788917011.853478:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2374:x1875815113524480:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917011.853506:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2374:x1875815113524480:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917011.853512:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:2.0:1788917011.854075:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113524736 00000100:00100000:2.0:1788917011.854102:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113524736 00000100:00100000:2.0:1788917011.854180:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 146 00000100:00100000:2.0:1788917011.854189:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2374:x1875815113524736:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917011.854242:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2374:x1875815113524736:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 54us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917011.854249:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 146 00000100:00080000:0.0:1788917011.854396:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788917011.854402:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788917011.854405:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788917011.857250:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113524352 00000100:00100000:3.0:1788917011.857271:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113524352 00000100:00100000:3.0:1788917011.857381:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 294 00000100:00100000:3.0:1788917011.857391:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+13:2374:x1875815113524352:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917011.857560:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+13:2374:x1875815113524352:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 170us (4722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917011.857578:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 294 00000100:00100000:1.0:1788917011.885564:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917011.885840:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113524864 00000100:00100000:0.0:1788917011.885854:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113524864 00000100:00100000:0.0:1788917011.886214:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 239 00000100:00100000:0.0:1788917011.886228:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e1d3733-3759-4aa4-b321-e9a62c258363+5:12128:x1875815113524864:12345-192.168.202.40@tcp:101:lsof.0 00010000:00010000:0.0:1788917011.886258:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917011.886287:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e6a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f879 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917011.886397:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e6b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917011.886416:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917011.886433:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917011.886727:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788917011.886732:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1788917011.886818:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917011.886850:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3e00/0x51de7f756a83e6a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f879 expref: 7 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917011.886872:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e6b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f879 expref: 6 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917011.886894:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02f3ce00) 00010000:00010000:0.0:1788917011.886898:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788917011.886903:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2800, rc 0) 00000100:00100000:0.0:1788917011.887005:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e1d3733-3759-4aa4-b321-e9a62c258363+6:12128:x1875815113524864:12345-192.168.202.40@tcp:101:lsof.0 Request processed in 780us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917011.887022:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 239 00010000:00010000:3.0:1788917012.255569:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917013.280862:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788917013.813038:0:12717:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:23:31 (1788917011) 00010000:00010000:3.0:1788917014.306558:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917015.071511:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e371ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140768000:0@lo:400:kworker.0 00000100:00100000:0.0:1788917015.071624:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917015.071794:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140768000 00000100:00100000:3.0:1788917015.071810:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140768000 00000100:00100000:1.0:1788917015.071814:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e371adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140768384:0@lo:400:kworker.0 00000100:00100000:1.0:1788917015.071872:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917015.072055:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140768384 00000100:00100000:1.0:1788917015.072217:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140768384 00000100:00100000:1.0:1788917015.072314:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788917015.072327:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140768384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917015.072422:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140768384:12345-0@lo:400:kworker.0 Request processed in 98us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917015.072431:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788917015.072544:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788917015.072554:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140768000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917015.072573:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e371adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140768384:0@lo:400:kworker.0 00000100:00100000:3.0:1788917015.072602:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140768000:12345-0@lo:400:kworker.0 Request processed in 50us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917015.072610:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:1.0:1788917015.072626:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917015.072661:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e371aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140768256:0@lo:400:kworker.0 00000100:00100000:0.0:1788917015.073861:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e371ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140768000:0@lo:400:kworker.0 00000100:00100000:0.0:1788917015.073934:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e371ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140768128:0@lo:400:kworker.0 00000100:00100000:1.0:1788917015.073986:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917015.074040:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917015.074074:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140768256 00000100:00100000:1.0:1788917015.074082:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140768256 00000100:00100000:1.0:1788917015.074136:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140768128 00000100:00080000:0.0:1788917015.074140:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917015.074141:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140768128 00000100:00100000:1.0:1788917015.074207:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788917015.074217:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140768256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917015.074230:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788917015.074246:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140768128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917015.074284:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140768256:12345-0@lo:400:kworker.0 Request processed in 67us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917015.074293:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788917015.074346:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e371aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140768256:0@lo:400:kworker.0 00000100:00100000:0.0:1788917015.075389:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140768128:12345-0@lo:400:kworker.0 Request processed in 1146us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917015.075864:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788917015.076583:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788917015.076601:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e371aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140768512:0@lo:400:kworker.0 00000100:00100000:2.0:1788917015.077133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917015.077213:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788917015.077224:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e371ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140768640:0@lo:400:kworker.0 00000100:00100000:2.0:1788917015.077260:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917015.077292:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140768640 00000100:00100000:2.0:1788917015.077312:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140768640 00000100:00100000:2.0:1788917015.077371:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788917015.077379:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f379180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140768640:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788917015.077559:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788917015.077634:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140768512 00000100:00100000:1.0:1788917015.077639:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140768512 00000100:00100000:3.0:1788917015.077723:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e371ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140768128:0@lo:400:kworker.0 00000100:00100000:1.0:1788917015.077873:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788917015.077882:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e371adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140768512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917015.077989:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e371adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140768512:12345-0@lo:400:kworker.0 Request processed in 108us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917015.077997:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788917015.078083:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e371aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140768512:0@lo:400:kworker.0 00000100:00080000:0.0:1788917015.078129:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917015.078231:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f379180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140768640:12345-0@lo:400:kworker.0 Request processed in 851us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917015.078239:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788917015.078383:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1788917015.078389:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6e37134700, transno 4294967321 00000004:00080000:1.0:1788917015.078543:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:1.0:1788917015.078569:0:3307:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9a6e371afb80 x1875815140767872/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788917027 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788917015.078582:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e371ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140768640:0@lo:400:kworker.0 00010000:00010000:2.0:1788917015.327353:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917015.583949:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140768768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917015.584127:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917015.584766:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140768768 00000100:00100000:3.0:1788917015.584777:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140768768 00000100:00100000:3.0:1788917015.584841:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788917015.584852:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e373e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140768768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788917015.584901:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788917015.585658:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e373e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140768768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 804us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917015.585667:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788917015.586169:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140768768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917016.024499:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917016.024588:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113525120 00000100:00100000:1.0:1788917016.024601:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113525120 00000100:00080000:0.0:1788917016.024750:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917016.024795:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:1.0:1788917016.024820:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+19:12349:x1875815113525120:12345-192.168.202.40@tcp:35:umount.0 00000100:00100000:1.0:1788917016.025470:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:12349:x1875815113525120:12345-192.168.202.40@tcp:35:umount.0 Request processed in 664us (983us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788917016.025478:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:1.0:1788917016.032439:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917016.032505:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113525376 00000100:00100000:2.0:1788917016.032518:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113525376 00000100:00100000:2.0:1788917016.032612:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:2.0:1788917016.032624:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+20:12349:x1875815113525376:12345-192.168.202.40@tcp:35:umount.0 00000100:00100000:2.0:1788917016.033059:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+21:12349:x1875815113525376:12345-192.168.202.40@tcp:35:umount.0 Request processed in 437us (629us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788917016.033087:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:2.0:1788917016.035254:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917016.035346:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113525632 00000100:00100000:1.0:1788917016.035358:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113525632 00000100:00100000:1.0:1788917016.035419:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:1.0:1788917016.035430:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e08cfac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+21:12349:x1875815113525632:12345-192.168.202.40@tcp:35:umount.0 00000100:00100000:1.0:1788917016.035970:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e08cfac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+22:12349:x1875815113525632:12345-192.168.202.40@tcp:35:umount.0 Request processed in 541us (724us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788917016.035979:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:0.0:1788917016.039337:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917016.039434:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113525888 00000100:00100000:2.0:1788917016.039448:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113525888 00000100:00100000:2.0:1788917016.039527:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:2.0:1788917016.039542:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+22:12349:x1875815113525888:12345-192.168.202.40@tcp:35:umount.0 00000100:00100000:2.0:1788917016.040045:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+23:12349:x1875815113525888:12345-192.168.202.40@tcp:35:umount.0 Request processed in 506us (719us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788917016.040054:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:2.0:1788917016.049314:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917016.049355:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917016.049388:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917016.049432:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113526016 00000100:00100000:0.0:1788917016.049432:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113526272 00000100:00100000:1.0:1788917016.049445:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113526016 00000100:00100000:0.0:1788917016.049445:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113526272 00000100:00100000:0.0:1788917016.049570:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113526144 00000100:00100000:0.0:1788917016.049575:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113526144 00000100:00100000:3.0:1788917016.051384:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:3.0:1788917016.051408:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f327480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f367f55b-9b55-442e-a009-d3d404e176a2+15:2371:x1875815113526272:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917016.051452:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917016.051482:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e06ee2a00/0x51de7f756a83d93c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4cf expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917016.051505:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917016.051589:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f327480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f367f55b-9b55-442e-a009-d3d404e176a2+14:2371:x1875815113526272:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 192us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917016.051599:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:3.0:1788917016.051629:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:3.0:1788917016.051636:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f327800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f367f55b-9b55-442e-a009-d3d404e176a2+13:2371:x1875815113526016:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917016.051645:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917016.051656:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0149f600/0x51de7f756a83d728 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f404 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917016.051666:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917016.051684:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f327800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f367f55b-9b55-442e-a009-d3d404e176a2+12:2371:x1875815113526016:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 49us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917016.051691:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:3.0:1788917016.051707:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:3.0:1788917016.051714:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f326680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f367f55b-9b55-442e-a009-d3d404e176a2+11:2371:x1875815113526144:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917016.051722:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917016.051731:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0168f400/0x51de7f756a83d68e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f3cc expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917016.051742:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917016.051758:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f326680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f367f55b-9b55-442e-a009-d3d404e176a2+10:2371:x1875815113526144:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 45us (2370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917016.051772:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:1.0:1788917016.054124:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917016.054377:0:8068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113526656 00000100:00100000:3.0:1788917016.054387:0:8068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113526656 00000100:00100000:3.0:1788917016.054461:0:8068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:3.0:1788917016.054472:0:8068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+7:2370:x1875815113526656:12345-192.168.202.40@tcp:9:umount.0 00000020:00000080:3.0:1788917016.054510:0:8068:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83dc68 00000020:00010000:3.0:1788917016.054520:0:8068:0:(genops.c:1950:obd_stale_export_put()) Put export ffff9a6e06d92800: total 0 00000100:00080000:3.0:1788917016.054524:0:8068:0:(import.c:65:import_set_state_nolock()) ffff9a6e06d96000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788917016.054577:0:8068:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:1.0:1788917016.054606:0:5780:0:(genops.c:1936:obd_stale_export_get()) Get export ffff9a6e06d92800: total 0 00010000:00010000:1.0:1788917016.054657:0:5780:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a6e06d92800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788917016.054722:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83e004 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6a4 expref: 6 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788917016.054876:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788917016.055142:0:8068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9afe8ff0-67c2-4292-b970-4ecb57096cb4+4:2370:x1875815113526656:12345-192.168.202.40@tcp:9:umount.0 Request processed in 670us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917016.055180:0:8068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 72 00010000:00010000:1.0:1788917016.055925:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f23f8dc2/0x51de7f756a83e6a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f872 expref: 3 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917016.055956:0:5780:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a6e06d92800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788917016.055980:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917016.055982:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917016.055998:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917016.065040:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917016.066937:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113526784 00000100:00100000:0.0:1788917016.066955:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113526784 00000100:00080000:2.0:1788917016.067029:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917016.067064:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:0.0:1788917016.067077:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+5:2370:x1875815113526784:12345-192.168.202.40@tcp:9:umount.0 00000020:00000080:0.0:1788917016.067138:0:6592:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83da00 00000100:00080000:0.0:1788917016.067187:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9a6e03d1e000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788917016.067228:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788917016.067235:0:6592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788917016.067592:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9afe8ff0-67c2-4292-b970-4ecb57096cb4+2:2370:x1875815113526784:12345-192.168.202.40@tcp:9:umount.0 Request processed in 518us (2566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917016.067602:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:0.0:1788917016.079750:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917016.086523:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113527808 00000100:00100000:2.0:1788917016.086546:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113527808 00000100:00100000:2.0:1788917016.086648:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 240 00000100:00100000:2.0:1788917016.086660:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+23:2370:x1875815113527808:12345-192.168.202.40@tcp:39:umount.0 00000020:00000080:2.0:1788917016.086708:0:5792:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d69c 00000020:00010000:2.0:1788917016.086769:0:5792:0:(genops.c:1950:obd_stale_export_put()) Put export ffff9a6e2d1a3800: total 0 00000100:00080000:2.0:1788917016.086775:0:5792:0:(import.c:65:import_set_state_nolock()) ffff9a6e07589800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788917016.087065:0:5792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1788917016.087788:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9afe8ff0-67c2-4292-b970-4ecb57096cb4+22:2370:x1875815113527808:12345-192.168.202.40@tcp:39:umount.0 Request processed in 1126us (8047us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788917016.087799:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 240 00000020:00010000:0.0:1788917016.089363:0:5780:0:(genops.c:1936:obd_stale_export_get()) Get export ffff9a6e2d1a3800: total 0 00010000:00010000:0.0:1788917016.089373:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917016.089431:0:5780:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a6e2d1a3800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788917016.089522:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:0.0:1788917016.089526:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917016.089538:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e013fc000/0x51de7f756a83d982 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4e4 expref: 21 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917016.089571:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:0.0:1788917016.089574:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788917016.089578:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e200/0x51de7f756a83dfc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f68f expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917016.090340:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:0.0:1788917016.090345:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788917016.090351:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaae00/0x51de7f756a83e663 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f85d expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917016.090371:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02f3ce00) 00010000:00010000:0.0:1788917016.090374:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788917016.090399:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f600/0x51de7f756a83e066 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6c0 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917016.090418:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6e02cee500) 00010000:00010000:0.0:1788917016.090420:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788917016.090424:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83d966 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4dd expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917016.090445:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:0.0:1788917016.090448:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788917016.090452:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee3c00/0x51de7f756a83dfef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f69d expref: 16 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917016.090464:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:0.0:1788917016.090467:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788917016.090470:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83e68d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f86b expref: 15 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917016.090484:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:0.0:1788917016.090487:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788917016.090490:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeab600/0x51de7f756a83d9d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4f9 expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917016.090502:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a6e02cee900) 00010000:00010000:0.0:1788917016.090504:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788917016.090507:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83e583 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f825 expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917016.090522:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a6e1959ed00) 00010000:00010000:0.0:1788917016.090529:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788917016.090534:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e00031400/0x51de7f756a83dcc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f5cb expref: 12 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917016.090556:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:0.0:1788917016.090558:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788917016.090562:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e400/0x51de7f756a83e082 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f6c7 expref: 11 pid: 8069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917016.090574:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a6e02ceed00) 00010000:00010000:0.0:1788917016.090576:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788917016.090579:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ee00/0x51de7f756a83e361 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f799 expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917016.090592:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a6e03d86c00) 00010000:00010000:0.0:1788917016.090593:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788917016.090596:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1eeaa000/0x51de7f756a83dee5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f657 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917016.090608:0:5780:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a6e2d1a3800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788917016.090629:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917016.090631:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917016.090633:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917016.096572:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140768896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917016.096644:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917016.096706:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140768896 00000100:00100000:1.0:1788917016.096712:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140768896 00000100:00100000:1.0:1788917016.096751:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788917016.096757:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140768896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788917016.096793:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917016.096833:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140768896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917016.096851:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788917016.096907:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140768896:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788917016.121358:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:1.0:1788917016.121977:0:5814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9afe8ff0-67c2-4292-b970-4ecb57096cb4 00000001:00080000:1.0:1788917016.121990:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1788917016.122002:0:5814:0:(genops.c:907:class_export_put()) final put ffff9a6e2d1a3800/9afe8ff0-67c2-4292-b970-4ecb57096cb4 00000020:00080000:1.0:1788917016.122065:0:5814:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1788917016.122481:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788917016.122494:0:5825:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00000080:2.0:1788917016.124797:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e2d1a3800/9afe8ff0-67c2-4292-b970-4ecb57096cb4 for lustre-MDT0000 00000020:00000080:2.0:1788917016.124895:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e07589800 for lustre-MDT0000 00000001:00080000:0.0:1788917016.136371:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00100000:0.0:1788917016.136395:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9afe8ff0-67c2-4292-b970-4ecb57096cb4 00000020:00000080:0.0:1788917016.136400:0:7503:0:(genops.c:907:class_export_put()) final put ffff9a6e06d92800/9afe8ff0-67c2-4292-b970-4ecb57096cb4 00000020:00000080:2.0:1788917016.136470:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e06d92800/9afe8ff0-67c2-4292-b970-4ecb57096cb4 for lustre-OST0001 00000020:00000080:2.0:1788917016.136533:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e06d96000 for lustre-OST0001 00010000:00010000:2.0:1788917016.351593:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917016.693469:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917016.693573:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917016.693665:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917016.693736:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113528064 00000100:00100000:3.0:1788917016.693747:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113528064 00000100:00100000:3.0:1788917016.693831:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113527936 00000100:00100000:3.0:1788917016.693834:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113527936 00000100:00100000:3.0:1788917016.693862:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1788917016.693873:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f367f55b-9b55-442e-a009-d3d404e176a2+11:2371:x1875815113528064:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917016.693894:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917016.693921:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e06ee3600/0x51de7f756a83d775 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f443 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917016.693944:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917016.694004:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f367f55b-9b55-442e-a009-d3d404e176a2+10:2371:x1875815113528064:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 133us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917016.694012:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1788917016.694043:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:3.0:1788917016.694071:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e408e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f367f55b-9b55-442e-a009-d3d404e176a2+9:2371:x1875815113527936:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917016.694080:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917016.694090:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e2d18fe00/0x51de7f756a83d76e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f419 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917016.694104:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917016.694124:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e408e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f367f55b-9b55-442e-a009-d3d404e176a2+8:2371:x1875815113527936:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 55us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917016.694132:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:2.0:1788917016.695027:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917016.695184:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113528448 00000100:00100000:0.0:1788917016.695212:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113528448 00000100:00100000:0.0:1788917016.695279:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 241 00000100:00100000:0.0:1788917016.695298:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+6:2370:x1875815113528448:12345-192.168.202.40@tcp:39:umount.0 00000020:00000080:0.0:1788917016.695344:0:5793:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d783 00000020:00010000:0.0:1788917016.695353:0:5793:0:(genops.c:1950:obd_stale_export_put()) Put export ffff9a6e3f7f8000: total 0 00000100:00080000:0.0:1788917016.695358:0:5793:0:(import.c:65:import_set_state_nolock()) ffff9a6e3f7fd000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788917016.695381:0:5793:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1788917016.695887:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e1d3733-3759-4aa4-b321-e9a62c258363+5:2370:x1875815113528448:12345-192.168.202.40@tcp:39:umount.0 Request processed in 586us (861us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788917016.695897:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 241 00000020:00010000:0.0:1788917016.695957:0:5780:0:(genops.c:1936:obd_stale_export_get()) Get export ffff9a6e3f7f8000: total 0 00010000:00010000:0.0:1788917016.696005:0:5780:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a6e3f7f8000, canceled 0 locks, left on hash table 1. 00000100:00080000:2.0:1788917016.696401:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788917016.696756:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e02f3ce00) 00010000:00010000:0.0:1788917016.696760:0:5780:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788917016.696772:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2800/0x51de7f756a83e6b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f879 expref: 4 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917016.696804:0:5780:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a6e3f7f8000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788917016.696820:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917016.696823:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917016.696825:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917016.696986:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113528192 00000100:00100000:1.0:1788917016.696996:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113528192 00000100:00100000:3.0:1788917016.697350:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:3.0:1788917016.697364:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f367f55b-9b55-442e-a009-d3d404e176a2+8:2371:x1875815113528192:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917016.697383:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917016.697399:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e013fca00/0x51de7f756a83d935 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f4c8 expref: 8 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917016.697414:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917016.697470:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f367f55b-9b55-442e-a009-d3d404e176a2+7:2371:x1875815113528192:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 110us (3804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917016.697478:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:2.0:1788917016.715667:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917016.715793:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113528704 00000100:00100000:3.0:1788917016.715806:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113528704 00000100:00100000:3.0:1788917016.715974:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 296 00000100:00100000:3.0:1788917016.715987:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+7:2370:x1875815113528704:12345-192.168.202.40@tcp:251:umount.0 00000020:00000080:3.0:1788917016.716063:0:5787:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d679 00000020:00010000:3.0:1788917016.716076:0:5787:0:(genops.c:1950:obd_stale_export_put()) Put export ffff9a6e3fe0c000: total 0 00000100:00080000:3.0:1788917016.716081:0:5787:0:(import.c:65:import_set_state_nolock()) ffff9a6e3fe0c800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1788917016.716278:0:5781:0:(genops.c:1936:obd_stale_export_get()) Get export ffff9a6e3fe0c000: total 0 00010000:00010000:1.0:1788917016.716292:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917016.716352:0:5781:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a6e3fe0c000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788917016.716397:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0149e200/0x51de7f756a83d72f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f40b expref: 3 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917016.716417:0:5781:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a6e3fe0c000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788917016.716427:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917016.716428:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917016.716430:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917016.716515:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f367f55b-9b55-442e-a009-d3d404e176a2+1:2370:x1875815113528704:12345-192.168.202.40@tcp:251:umount.0 Request processed in 529us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917016.716540:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 296 00000020:00000080:3.0:1788917016.716551:0:5787:0:(genops.c:907:class_export_put()) final put ffff9a6e3fe0c000/f367f55b-9b55-442e-a009-d3d404e176a2 00000020:00000080:1.0:1788917016.717957:0:8:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e3fe0c000/f367f55b-9b55-442e-a009-d3d404e176a2 for MGS 00000020:00000080:1.0:1788917016.718379:0:8:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e3fe0c800 for MGS 00010000:00010000:2.0:1788917017.375296:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788917017.615693:0:12915:0:(tgt_mount.c:2284:server_umount_begin()) umount -f 00000020:01000004:1.0:1788917017.626352:0:12915:0:(tgt_mount.c:2144:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788917017.626418:0:12915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab000/0x51de7f756a83d6fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d705 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917017.626432:0:12915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab000/0x51de7f756a83d6fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d705 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917017.626457:0:12915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab000/0x51de7f756a83d6fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d705 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917017.626470:0:12915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab000/0x51de7f756a83d6fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d705 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917017.626496:0:12915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788917017.626502:0:12915:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788917017.626527:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788917017.626538:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab000/0x51de7f756a83d6fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d705 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788917017.626538:0:12915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788917017.626546:0:12915:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788917017.626551:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab000 already unused, calling callback (ffffffffc1d46c20) 00000100:00080000:1.0:1788917017.626553:0:12915:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 10000000:00010000:2.0:1788917017.626557:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab000/0x51de7f756a83d6fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d705 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917017.626569:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab000/0x51de7f756a83d6fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x51de7f756a83d705 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788917017.626576:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab000/0x51de7f756a83d6fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x51de7f756a83d705 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788917017.626582:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788917017.626585:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00080000:1.0:1788917017.626586:0:12915:0:(import.c:65:import_set_state_nolock()) ffff9a6e1ecff000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:2.0:1788917017.626589:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788917017.626625:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab000/0x51de7f756a83d6fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d705 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917017.626636:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788917017.626666:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab000/0x51de7f756a83d6fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d705 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917017.626673:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab000/0x51de7f756a83d6fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d705 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917017.626679:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f626a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140769152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788917017.626687:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875815140769024:0@lo:39:umount.0 00010000:00010000:2.0:1788917017.626688:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917017.626692:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917017.626696:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917017.626766:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917017.626767:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917017.626821:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140769024 00000100:00100000:2.0:1788917017.626829:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140769024 00000100:00100000:2.0:1788917017.626900:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788917017.626910:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875815140769024:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788917017.626945:0:5794:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d488 00000100:00080000:2.0:1788917017.626953:0:5794:0:(import.c:65:import_set_state_nolock()) ffff9a6e3b15d800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788917017.626985:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917017.627019:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3303:x1875815140769024:12345-0@lo:39:umount.0 Request processed in 111us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917017.627027:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1788917017.627039:0:5794:0:(genops.c:907:class_export_put()) final put ffff9a6e3b159000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1788917017.627051:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e1ecff000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788917017.627061:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875815140769024:0@lo:39:umount.0 00000020:00000080:1.0:1788917017.627079:0:8:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e3b159000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788917017.627177:0:8:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e3b15d800 for lustre-MDT0000 00000100:00080000:1.0:1788917017.627194:0:12915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788917017.627197:0:12915:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788917017.627201:0:12915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1788917017.627227:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140769152 00000100:00100000:0.0:1788917017.627233:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140769152 00000100:00100000:0.0:1788917017.627296:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788917017.627306:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a680e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4933373a-b540-4420-bf34-9071e19d7373+19:3305:x1875815140769152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788917017.627319:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917017.627337:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e013fd200/0x51de7f756a83d705 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x51de7f756a83d6fe expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917017.627364:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788917017.627412:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a680e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4933373a-b540-4420-bf34-9071e19d7373+18:3305:x1875815140769152:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917017.627420:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788917017.627438:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f626a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4933373a-b540-4420-bf34-9071e19d7373:3305:1875815140769152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788917017.628037:0:12915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2600/0x51de7f756a83d70c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d713 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917017.628044:0:12915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2600/0x51de7f756a83d70c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d713 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917017.628048:0:12915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2600/0x51de7f756a83d70c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d713 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917017.628061:0:12915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2600/0x51de7f756a83d70c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d713 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917017.628074:0:12915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788917017.628078:0:12915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d633 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d63a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917017.628082:0:12915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d633 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d63a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917017.628087:0:12915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d633 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d63a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917017.628090:0:12915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d63a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917017.628098:0:12915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788917017.628102:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788917017.628105:0:12915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fd800/0x51de7f756a83d920 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d927 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917017.628109:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2600/0x51de7f756a83d70c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d713 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917017.628114:0:12915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fd800/0x51de7f756a83d920 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d927 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917017.628124:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2600 already unused, calling callback (ffffffffc1d46c20) 00010000:00010000:1.0:1788917017.628127:0:12915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e013fd800/0x51de7f756a83d920 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d927 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917017.628129:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1788917017.628130:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2600/0x51de7f756a83d70c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d713 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917017.628135:0:12915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9a6e013fd800/0x51de7f756a83d920 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d927 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917017.628188:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2600/0x51de7f756a83d70c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x51de7f756a83d713 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917017.628192:0:12915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:2.0:1788917017.628196:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2600/0x51de7f756a83d70c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x51de7f756a83d713 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788917017.628201:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788917017.628201:0:12915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f000/0x51de7f756a83d3e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d3ee expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788917017.628205:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788917017.628214:0:12915:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f000/0x51de7f756a83d3e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d3ee expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917017.628223:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2600/0x51de7f756a83d70c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d713 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917017.628223:0:12915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f000/0x51de7f756a83d3e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d3ee expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917017.628242:0:12915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f000/0x51de7f756a83d3e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d3ee expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917017.628244:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788917017.628254:0:12915:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788917017.628259:0:12915:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788917017.628263:0:12915:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788917017.628265:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2600/0x51de7f756a83d70c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d713 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917017.628283:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2600/0x51de7f756a83d70c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d713 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917017.628294:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:01000004:1.0:1788917017.628296:0:12915:0:(tgt_mount.c:2204:server_put_super()) stopping lustre-MDT0000 00000100:00100000:3.0:1788917017.628299:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f626a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140769280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788917017.628301:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e013fd800/0x51de7f756a83d920 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d927 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1788917017.628302:0:12915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:2.0:1788917017.628311:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e013fd800 already unused, calling callback (ffffffffc1d46c20) 00000020:00000080:1.0:1788917017.628312:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 10000000:00010000:2.0:1788917017.628315:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e013fd800/0x51de7f756a83d920 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d927 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788917017.628320:0:12915:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00010000:00010000:2.0:1788917017.628321:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e013fd800/0x51de7f756a83d920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x51de7f756a83d927 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788917017.628328:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e013fd800/0x51de7f756a83d920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x51de7f756a83d927 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788917017.628329:0:12915:0:(genops.c:1848:print_export_data()) lustre-MDT0000: ACTIVE ffff9a6e2d1a0000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788917017.628338:0:12915:0:(genops.c:1848:print_export_data()) lustre-MDT0000: ACTIVE ffff9a6e3f43f800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:3.0:1788917017.628340:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1788917017.628349:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788917017.628352:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00000020:00080000:1.0:1788917017.628354:0:12915:0:(genops.c:1848:print_export_data()) lustre-MDT0000: UNLINKED ffff9a6e3f7f8000 3e1d3733-3759-4aa4-b321-e9a62c258363 192.168.202.40@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:2.0:1788917017.628359:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:1.0:1788917017.628362:0:12915:0:(genops.c:1582:class_disconnect_exports()) OBD device 5 (ffff9a6e0a7399c0) has exports, disconnecting them 00000020:00080000:1.0:1788917017.628368:0:12915:0:(genops.c:1557:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a6e2d1a0000), last request at 1788917015 00000020:00000080:1.0:1788917017.628373:0:12915:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d5fb 00000100:00100000:0.0:1788917017.628381:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140769280 00010000:00010000:2.0:1788917017.628382:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e013fd800/0x51de7f756a83d920 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d927 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917017.628388:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140769280 00000100:00080000:1.0:1788917017.628390:0:12915:0:(import.c:65:import_set_state_nolock()) ffff9a6e2d1a5000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788917017.628391:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788917017.628410:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e013fd800/0x51de7f756a83d920 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d927 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917017.628419:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e013fd800/0x51de7f756a83d920 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d927 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917017.628432:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788917017.628437:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788917017.628439:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f000/0x51de7f756a83d3e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d3ee expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788917017.628439:0:12915:0:(genops.c:1562:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6e2d1a0000): rc 0 00000020:00000080:1.0:1788917017.628445:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e2d1a0000/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:0.0:1788917017.628451:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+18:3306:x1875815140769280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788917017.628453:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f000 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:2.0:1788917017.628459:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f000/0x51de7f756a83d3e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d3ee expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788917017.628462:0:12915:0:(genops.c:1557:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a6e3f43f800), last request at 1788917015 00010000:00010000:0.0:1788917017.628466:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:1.0:1788917017.628470:0:12915:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d530 00010000:00010000:2.0:1788917017.628474:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f000/0x51de7f756a83d3e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x51de7f756a83d3ee expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788917017.628478:0:12915:0:(import.c:65:import_set_state_nolock()) ffff9a6e3f43a000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788917017.628479:0:8:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e2d1a0000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 10000000:00010000:2.0:1788917017.628481:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f000/0x51de7f756a83d3e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x51de7f756a83d3ee expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917017.628484:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0149f400/0x51de7f756a83d713 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x51de7f756a83d70c expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788917017.628490:0:12915:0:(genops.c:1562:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6e3f43f800): rc 0 10000000:01000000:2.0:1788917017.628491:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000020:00000080:1.0:1788917017.628496:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e3f43f800/lustre-MDT0000-lwp-OST0000_UUID 10000000:01000000:2.0:1788917017.628497:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788917017.628501:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788917017.628510:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00000080:1.0:1788917017.628512:0:12915:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb14040da3ae0 00000020:00000080:3.0:1788917017.628521:0:8:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e2d1a5000 for lustre-MDT0000 00000020:00000080:3.0:1788917017.628527:0:8:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e3f43f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:2.0:1788917017.628532:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f000/0x51de7f756a83d3e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d3ee expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788917017.628534:0:12915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788917017.628539:0:12915:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00010000:00010000:2.0:1788917017.628544:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788917017.628550:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4933373a-b540-4420-bf34-9071e19d7373+17:3306:x1875815140769280:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (210us total) trans 0 rc 0/0 00000020:00000080:3.0:1788917017.628554:0:8:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e3f43a000 for lustre-MDT0000 00000004:00080000:1.0:1788917017.628554:0:12915:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788917017.628562:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788917017.628576:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f000/0x51de7f756a83d3e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d3ee expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917017.628585:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f000/0x51de7f756a83d3e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d3ee expref: -99 pid: 5773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917017.628604:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917017.628606:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917017.628610:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917017.628610:0:12916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917017.628616:0:12916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917017.628620:0:12916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917017.628625:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d63a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917017.628626:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4933373a-b540-4420-bf34-9071e19d7373:3307:1875815140769408:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788917017.628633:0:12915:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:3.0:1788917017.628637:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00030400 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1788917017.628640:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d63a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788917017.628646:0:12915:0:(import.c:65:import_set_state_nolock()) ffff9a6e0b4de000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788917017.628648:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x51de7f756a83d63a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788917017.628655:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d633 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x51de7f756a83d63a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788917017.628663:0:12915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788917017.628666:0:12915:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 3 00000100:00100000:2.0:1788917017.628672:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1788917017.628677:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1788917017.628677:0:12915:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9a6e371afb80 x1875815140767872/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788917027 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788917017.628681:0:5780:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788917017.628683:0:5780:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00100000:0.0:1788917017.628687:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140769664:0@lo:9:umount.0 00000004:00080000:1.0:1788917017.628688:0:12915:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6e371afb80, transno 4294967324 00010000:00010000:3.0:1788917017.628700:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d633 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d63a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917017.628707:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00080000:1.0:1788917017.628711:0:12915:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788917017.628713:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140769536:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788917017.628715:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d633 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d63a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917017.628722:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e00030400/0x51de7f756a83d633 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d63a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917017.628733:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788917017.628741:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917017.628745:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917017.628747:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917017.628763:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788917017.628780:0:12915:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788917017.628782:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140769664 00000100:00100000:0.0:1788917017.628788:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140769664 00000100:00080000:1.0:1788917017.628792:0:12915:0:(import.c:65:import_set_state_nolock()) ffff9a6e1ecf8000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788917017.628806:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788917017.628815:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140769792:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788917017.628853:0:12915:0:(genops.c:1587:class_disconnect_exports()) OBD device 5 (ffff9a6e0a7399c0) has no exports 00000100:00100000:2.0:1788917017.628854:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917017.628854:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788917017.628868:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875815140769664:12345-0@lo:9:umount.0 00000100:00100000:3.0:1788917017.628886:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140769408 00000100:00100000:3.0:1788917017.628891:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140769408 00000020:00000080:0.0:1788917017.628892:0:6590:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d58b 00000100:00080000:0.0:1788917017.628902:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9a6e0b4de800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788917017.628933:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140769536 00000100:00100000:3.0:1788917017.628938:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140769536 00000100:00080000:2.0:1788917017.628942:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788917017.628951:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788917017.628957:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788917017.628961:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140769792 00000100:00100000:3.0:1788917017.628966:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788917017.628967:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140769792 00000100:00100000:3.0:1788917017.628977:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4933373a-b540-4420-bf34-9071e19d7373+19:3307:x1875815140769408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788917017.628987:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917017.628998:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e013fdc00/0x51de7f756a83d927 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x51de7f756a83d920 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917017.629004:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1788917017.629012:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788917017.629027:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+18:3304:x1875815140769536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788917017.629037:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788917017.629047:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4933373a-b540-4420-bf34-9071e19d7373+18:3307:x1875815140769408:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (378us total) trans 0 rc 0/0 00010000:00010000:2.0:1788917017.629051:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0149e400/0x51de7f756a83d3ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x51de7f756a83d3e7 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917017.629069:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788917017.629070:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4933373a-b540-4420-bf34-9071e19d7373:3307:1875815140769408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788917017.629091:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1788917017.629093:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917017.629101:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4933373a-b540-4420-bf34-9071e19d7373+16:3304:x1875815140769792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788917017.629111:0:6606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917017.629123:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e06ee3800/0x51de7f756a83d63a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x51de7f756a83d633 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917017.629132:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4933373a-b540-4420-bf34-9071e19d7373+15:3304:x1875815140769536:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (369us total) trans 0 rc 0/0 00010000:00010000:3.0:1788917017.629136:0:6606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788917017.629141:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788917017.629196:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4933373a-b540-4420-bf34-9071e19d7373+14:3304:x1875815140769792:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917017.629197:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140769920:0@lo:9:umount.0 00000100:00100000:3.0:1788917017.629204:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788917017.629214:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f626a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140769280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788917017.629234:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3303:x1875815140769664:12345-0@lo:9:umount.0 Request processed in 366us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917017.629245:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788917017.629247:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917017.629249:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140769792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788917017.629264:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140769536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788917017.629269:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140769920 00000100:00100000:0.0:1788917017.629286:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140769920 00000100:00080000:1.0:1788917017.629298:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e0b4de000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788917017.629314:0:5788:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788917017.629316:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788917017.629319:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788917017.629324:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140769664:0@lo:9:umount.0 00000100:00100000:0.0:1788917017.629334:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788917017.629344:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875815140769920:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788917017.629357:0:6590:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d672 00000100:00080000:0.0:1788917017.629363:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9a6e3fe0d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788917017.629388:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:2.0:1788917017.629622:0:12916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917017.629648:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3303:x1875815140769920:12345-0@lo:9:umount.0 Request processed in 306us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917017.629657:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788917017.629665:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000100:00080000:1.0:1788917017.629670:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e1ecf8000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788917017.629679:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788917017.629680:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788917017.629683:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140769920:0@lo:9:umount.0 00000020:00080000:3.0:1788917017.636534:0:12915:0:(genops.c:1587:class_disconnect_exports()) OBD device 5 (ffff9a6e0a7399c0) has no exports 00000020:00000080:3.0:1788917017.697827:0:12915:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d442 00000020:00000080:3.0:1788917017.697844:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e2c9de000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788917017.697873:0:12915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788917017.697908:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e2c9de000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788917017.697998:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788917017.698008:0:12915:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788917017.698012:0:12915:0:(genops.c:1587:class_disconnect_exports()) OBD device 7 (ffff9a6e0a77cd40) has no exports 00000020:00000080:2.0:1788917017.698558:0:12915:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d43b 00000020:00000080:2.0:1788917017.698563:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e3b158000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788917017.698595:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e3b158000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788917017.698622:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788917017.698629:0:12915:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788917017.698632:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e2c9fe800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788917017.698634:0:12915:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e2c9fe800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788917017.698645:0:12915:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1788917018.402319:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788917018.685748:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788917018.685758:0:6617:0:(genops.c:907:class_export_put()) final put ffff9a6e0b4d8800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788917018.685786:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9afe8ff0-67c2-4292-b970-4ecb57096cb4 00000020:00000080:3.0:1788917018.685789:0:6617:0:(genops.c:907:class_export_put()) final put ffff9a6e03d1c000/9afe8ff0-67c2-4292-b970-4ecb57096cb4 00000020:00000080:0.0:1788917018.685835:0:8:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e0b4d8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788917018.685905:0:8:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e03d1c000/9afe8ff0-67c2-4292-b970-4ecb57096cb4 for lustre-OST0000 00000020:00000080:0.0:1788917018.685923:0:8:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e0b4de800 for lustre-OST0000 00000020:00000080:0.0:1788917018.685928:0:8:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e03d1e000 for lustre-OST0000 00010000:00010000:1.0:1788917019.423769:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917020.191636:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788917020.191636:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f626a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140770176:0@lo:400:kworker.0 00000100:00100000:2.0:1788917020.191656:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140770304:0@lo:400:kworker.0 00000100:00100000:3.0:1788917020.191664:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140770048:0@lo:400:kworker.0 00000100:00100000:3.0:1788917020.192405:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917020.192407:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917020.192444:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140770048 00000100:00100000:1.0:1788917020.192452:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140770048 00000100:00100000:3.0:1788917020.192492:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917020.192508:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788917020.192520:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1fe38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+14:3306:x1875815140770048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917020.192568:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140770304 00000100:00100000:0.0:1788917020.192574:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140770304 00000100:00100000:1.0:1788917020.192587:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1fe38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4933373a-b540-4420-bf34-9071e19d7373+14:3306:x1875815140770048:12345-0@lo:400:kworker.0 Request processed in 69us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917020.192596:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788917020.192608:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140770048:0@lo:400:kworker.0 00000100:00100000:0.0:1788917020.192610:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140770176 00000100:00100000:0.0:1788917020.192616:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140770176 00000100:00100000:0.0:1788917020.192643:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788917020.192650:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1875815140770304:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788917020.192659:0:5793:0:(tgt_handler.c:808:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788917020.192722:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788917020.192729:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875815140770176:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788917020.192736:0:5792:0:(tgt_handler.c:808:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788917020.192772:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875815140770176:12345-0@lo:400:kworker.0 Request processed in 41us (280us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788917020.192779:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1788917020.192791:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788917020.192810:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a6e3f62b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788917020.192814:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788917020.192908:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1875815140770304:12345-0@lo:400:kworker.0 Request processed in 256us (504us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788917020.192923:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:1.0:1788917020.192932:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788917020.192936:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9a6e3fe0f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788917020.192940:0:3305:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788917020.192962:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9a6e3fe0f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788917020.192966:0:3305:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 248 00000100:00080000:1.0:1788917020.192971:0:3305:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a6e3fe0f000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1788917020.192994:0:3305:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e3a681880 x1875815140770432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788917020.193016:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140770304:0@lo:400:kworker.0 00000100:00100000:0.0:1788917020.193316:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875815140770432:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788917020.193348:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917020.193442:0:8069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140770432 00000100:00100000:2.0:1788917020.193446:0:8069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140770432 00000100:00100000:2.0:1788917020.193627:0:8069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788917020.193632:0:8069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3303:x1875815140770432:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1788917020.193649:0:8069:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1788917020.201038:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a6e3f62b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788917020.201049:0:3307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 224 00000100:00080000:3.0:1788917020.201059:0:3307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a6e3f62b000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1788917020.201106:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e37136a00 x1875815140770560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788917020.201194:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875815140770560:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788917020.201286:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917020.201359:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140770560 00000100:00100000:3.0:1788917020.201369:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f626a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140770176:0@lo:400:kworker.0 00000100:00100000:1.0:1788917020.201369:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140770560 00000100:00100000:1.0:1788917020.201419:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788917020.201428:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875815140770560:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788917020.201448:0:5792:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788917020.201499:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875815140770560:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 70us (213us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788917020.201507:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1788917020.201557:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e3f62b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788917020.201562:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788917020.201566:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875815140770560:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788917020.210256:0:8069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3303:x1875815140770432:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 16593us (16877us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788917020.210272:0:8069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1788917020.210407:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e3fe0f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788917020.210414:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788917020.210419:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875815140770432:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1788917020.447466:0:12916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788917021.233301:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788917021.233311:0:7503:0:(genops.c:907:class_export_put()) final put ffff9a6e3fe08000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788917021.233366:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e3fe08000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000001:00100000:2.0:1788917021.233430:0:5814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3e1d3733-3759-4aa4-b321-e9a62c258363 00000020:00000080:3.0:1788917021.233432:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e3fe0d000 for lustre-OST0001 00000001:00080000:2.0:1788917021.233444:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1788917021.233448:0:5814:0:(genops.c:907:class_export_put()) final put ffff9a6e3f7f8000/3e1d3733-3759-4aa4-b321-e9a62c258363 00000020:00000080:3.0:1788917021.233471:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e3f7f8000/3e1d3733-3759-4aa4-b321-e9a62c258363 for lustre-MDT0000 00000020:00000080:3.0:1788917021.233514:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e3f7fd000 for lustre-MDT0000 00010000:00010000:3.0:1788917021.472489:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917022.495535:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917023.524294:0:12916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788917023.776187:0:12915:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a6e06e124e0 - data ffff9a6e3f8ba5e8/ffff9a6e3fd82c00 00000020:01000000:3.0:1788917023.776347:0:12915:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a6e0827e060 - data ffff9a6e29022510/ffff9a6e1119a400 00000001:00000004:3.0:1788917023.789598:0:12915:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1788917023.846546:0:12915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788917023.846556:0:12915:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1788917023.846791:0:12915:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788917023.846796:0:12915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788917023.847355:0:6719:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788917023.847359:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1788917023.847368:0:6719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788917023.848344:0:12915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788917023.848356:0:12915:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1788917023.848371:0:12915:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788917023.848373:0:12915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788917023.848621:0:7870:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788917023.848626:0:7870:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 2 00000040:00080000:0.0:1788917023.848634:0:7870:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788917023.888902:0:12915:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d40a 00000020:00000080:1.0:1788917023.888926:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e2d52d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788917023.889818:0:12915:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d41f 00000020:00000080:1.0:1788917023.889824:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e2d52e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788917023.889830:0:12915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788917023.889834:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788917023.889842:0:12915:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788917023.889846:0:12915:0:(genops.c:1587:class_disconnect_exports()) OBD device 4 (ffff9a6e0a738000) has no exports 00000004:01000000:1.0:1788917023.890000:0:12915:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788917023.890010:0:12915:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d65d 00000020:00000080:1.0:1788917023.890014:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e07589000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788917023.890018:0:12915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788917023.890022:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788917023.890028:0:12915:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788917023.890030:0:12915:0:(genops.c:1587:class_disconnect_exports()) OBD device 17 (ffff9a6e1fe93380) has no exports 00000020:00000080:1.0:1788917023.890037:0:12915:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d656 00000020:00000080:1.0:1788917023.890040:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e1ecfb000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788917023.890306:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e2d52d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788917023.890325:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e2d52e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788917023.890344:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e07589000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788917023.890352:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e1ecfb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788917023.890422:0:12915:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788917023.890426:0:12915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788917023.890431:0:12915:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1788917023.890436:0:12915:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788917023.890439:0:12915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788917023.890613:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788917023.890625:0:12915:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788917023.890631:0:12915:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d576 00000020:00000080:1.0:1788917023.890636:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e0b4da000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788917023.890714:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e1ecf8000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788917023.890721:0:36:0:(genops.c:907:class_export_put()) final put ffff9a6e37250800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788917023.890723:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e37250800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788917023.890728:0:36:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788917023.890868:0:12915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788917023.890872:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788917023.890877:0:12915:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788917023.890879:0:12915:0:(genops.c:1587:class_disconnect_exports()) OBD device 13 (ffff9a6e2cd0b380) has no exports 00000020:00000080:1.0:1788917023.890883:0:12915:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d56f 00000020:00000080:1.0:1788917023.890887:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e0b4d9000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788917023.890905:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e0b4da000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1788917023.891569:0:12915:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788917023.891578:0:12915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788917023.891581:0:12915:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788917023.891585:0:12915:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788917023.891587:0:12915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788917023.891644:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e0b4d9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788917023.891773:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788917023.891779:0:12915:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788917023.891812:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788917023.891816:0:12915:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788917023.891819:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e0a783800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788917023.891822:0:12915:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e0a783800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788917023.891827:0:12915:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788917023.891986:0:12915:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d426 00000020:00000080:1.0:1788917023.891992:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e2d529000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788917023.892017:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e0b4de000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788917023.892022:0:36:0:(genops.c:907:class_export_put()) final put ffff9a6e2d52f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788917023.892024:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e2d52f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788917023.892028:0:36:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788917023.892290:0:12915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788917023.892295:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788917023.892300:0:12915:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788917023.892304:0:12915:0:(genops.c:1587:class_disconnect_exports()) OBD device 6 (ffff9a6e0a73cd40) has no exports 00000020:00000080:1.0:1788917023.892332:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788917023.892337:0:12915:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788917023.892342:0:12915:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d42d 00000020:00000080:1.0:1788917023.892346:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e2d52a800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788917023.892437:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e2d529000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788917023.892442:0:36:0:(genops.c:907:class_export_put()) final put ffff9a6e2d52e800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788917023.892444:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e2d52e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788917023.892448:0:36:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1788917023.892660:0:12915:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6e171d2800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788917023.892665:0:12915:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6e171d2800 3 00000020:01000004:1.0:1788917023.892670:0:12915:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a6e171d2800 from lustre-MDT0000 00000020:00000080:1.0:1788917023.892699:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788917023.892704:0:12915:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788917023.892708:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e2d52a000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788917023.892710:0:12915:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e2d52a000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788917023.892720:0:12915:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788917023.892752:0:12915:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788917023.892757:0:12915:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788917023.892792:0:12915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788917023.892802:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788917023.892805:0:12915:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788917023.892812:0:12915:0:(genops.c:1848:print_export_data()) MGS: ACTIVE ffff9a6e052ea800 4933373a-b540-4420-bf34-9071e19d7373 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788917023.892818:0:12915:0:(genops.c:1582:class_disconnect_exports()) OBD device 1 (ffff9a6e0b5c8000) has exports, disconnecting them 00000020:00080000:1.0:1788917023.892821:0:12915:0:(genops.c:1557:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a6e052ea800), last request at 1788916805 00000020:00000080:1.0:1788917023.892835:0:12915:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d3cb 00000020:00010000:1.0:1788917023.892839:0:12915:0:(genops.c:1950:obd_stale_export_put()) Put export ffff9a6e052ea800: total 1 00000100:00080000:1.0:1788917023.892844:0:12915:0:(import.c:65:import_set_state_nolock()) ffff9a6e052ee800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788917023.892863:0:12915:0:(genops.c:1562:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6e052ea800): rc 0 00000020:00080000:1.0:1788917023.892868:0:12915:0:(genops.c:1587:class_disconnect_exports()) OBD device 1 (ffff9a6e0b5c8000) has no exports 00000100:00100000:1.0:1788917023.892929:0:5784:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a6e07582200:5784] 0 exiting: rc = 1 00000020:00010000:0.0:1788917023.893044:0:5780:0:(genops.c:1936:obd_stale_export_get()) Get export ffff9a6e052ea800: total 1 00010000:00010000:0.0:1788917023.893102:0:5780:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a6e052ea800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788917023.893129:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83d90b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x51de7f756a83d904 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917023.893172:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e1eeaa800/0x51de7f756a83d6db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x51de7f756a83d6d4 expref: 8 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917023.893185:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e013fcc00/0x51de7f756a83d919 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x51de7f756a83d912 expref: 7 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917023.893199:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e013fde00/0x51de7f756a83d6cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x51de7f756a83d6c6 expref: 6 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917023.893211:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e1eeaa200/0x51de7f756a83d6e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x51de7f756a83d6e2 expref: 5 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917023.893235:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e013fd000/0x51de7f756a83d6f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x51de7f756a83d6f0 expref: 4 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917023.893248:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e00030600/0x51de7f756a83d4e3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x51de7f756a83d4dc expref: 3 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917023.893270:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e0149e600/0x51de7f756a83d721 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x51de7f756a83d71a expref: 2 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917023.893283:0:5780:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a6e052ea800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788917023.893296:0:5780:0:(genops.c:907:class_export_put()) final put ffff9a6e052ea800/4933373a-b540-4420-bf34-9071e19d7373 00000100:00100000:1.0:1788917023.893382:0:5786:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a6e08293000:5786] 1 exiting: rc = 0 00000020:00000080:3.0:1788917023.893541:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e2d52a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788917023.893575:0:5787:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a6e08293800:5787] 2 exiting: rc = 0 00000100:00100000:1.0:1788917023.893685:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893698:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893710:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893721:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893728:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893738:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893744:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893755:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893762:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893769:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893774:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893782:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893790:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893796:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893801:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893806:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893812:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893818:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893824:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893829:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893835:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893850:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893855:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893861:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893867:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893872:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893877:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893883:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893890:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893895:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893900:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893906:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893911:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893917:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893922:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893927:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893933:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893937:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893942:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893948:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893953:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893959:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893965:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893971:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893977:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893983:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893989:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.893994:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.894000:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.894006:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.894012:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.894017:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.894023:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.894029:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.894069:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.894076:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.894088:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.894094:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.894100:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.894105:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.894111:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.894116:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.894121:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.894126:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788917023.894691:0:12915:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788917023.894695:0:12915:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:0.0:1788917023.895430:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917023.895433:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917023.895435:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788917023.895696:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e052ea800/4933373a-b540-4420-bf34-9071e19d7373 for MGS 00000020:00000080:3.0:1788917023.895732:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e052ee800 for MGS 00000020:01000000:1.0:1788917023.896478:0:12915:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a6e2d1c00c0 - data ffff9a6e3f94c438/ffff9a6e37210000 00000020:01000000:1.0:1788917023.896595:0:12915:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a6e112b6240 - data ffff9a6e29025360/ffff9a6e0a743c00 00000020:00000080:1.0:1788917023.897310:0:12915:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d3af 00000020:00000080:1.0:1788917023.897318:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e0de8b800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788917023.897330:0:12915:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6e171d2800 from MGS, refs=2 00000020:01000004:1.0:1788917023.897333:0:12915:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6e171d2800 2 00000020:01000004:1.0:1788917023.897336:0:12915:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a6e171d2800 from MGS 00000020:00000080:1.0:1788917023.897433:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788917023.897442:0:12915:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788917023.897445:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e055aa800/MGS 00000020:00000080:1.0:1788917023.897447:0:12915:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e055aa800/MGS for MGS 00000020:01000000:1.0:1788917023.897456:0:12915:0:(genops.c:442:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788917023.897513:0:12915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788917023.897517:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788917023.897523:0:12915:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788917023.897529:0:12915:0:(genops.c:1848:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a6e1ecfc000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788917023.897541:0:12915:0:(genops.c:1582:class_disconnect_exports()) OBD device 8 (ffff9a6e2cd099c0) has exports, disconnecting them 00000020:00080000:1.0:1788917023.897546:0:12915:0:(genops.c:1557:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a6e1ecfc000), last request at 1788916806 00000020:00000080:1.0:1788917023.897550:0:12915:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d47a 00000020:00080000:1.0:1788917023.897564:0:12915:0:(genops.c:1562:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6e1ecfc000): rc 0 00000020:00000080:1.0:1788917023.897569:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e1ecfc000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788917023.898498:0:8:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e0de8b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788917023.898510:0:8:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e1ecfc000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788917023.899204:0:12915:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788917023.899210:0:12915:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788917023.899214:0:12915:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788917023.899230:0:12915:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788917023.899292:0:8:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e1ecff000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788917023.899560:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788917023.899571:0:12915:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788917023.899578:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e0a780800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788917023.899582:0:12915:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e0a780800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788917023.899596:0:12915:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788917023.899736:0:12915:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6e171d2800 1 00000020:00000080:0.0:1788917023.899744:0:12915:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d3a1 00000020:00000080:0.0:1788917023.899750:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e055a9000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788917023.899801:0:12915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788917023.899806:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788917023.899811:0:12915:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788917023.899816:0:12915:0:(genops.c:1587:class_disconnect_exports()) OBD device 0 (ffff9a6e0b5cb380) has no exports 00000020:00000080:3.0:1788917023.899897:0:8:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e055a9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788917023.915638:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788917023.915654:0:12915:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788917023.915660:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e171d0800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788917023.915665:0:12915:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e171d0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788917023.915673:0:12915:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788917023.916200:0:12915:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a6e171d6800 00000020:01000000:0.0:1788917023.916231:0:12915:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788917023.916236:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788917023.916240:0:12915:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788917023.916244:0:12915:0:(genops.c:1587:class_disconnect_exports()) OBD device 3 (ffff9a6e0a7799c0) has no exports 00000100:00100000:0.0:1788917023.916326:0:5794:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a6e0a78be00:5794] 2 exiting: rc = 0 00000100:00100000:0.0:1788917023.916921:0:5793:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a6e0a78a000:5793] 1 exiting: rc = 0 00000100:00100000:1.0:1788917023.917799:0:5792:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a6e0a788600:5792] 0 exiting: rc = 1 00000100:00100000:2.0:1788917023.917853:0:8069:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a6e36ce5800:8069] 3 exiting: rc = 0 00000100:00100000:0.0:1788917023.918207:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918228:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918235:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918246:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918253:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918260:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918266:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918271:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918278:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918284:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918290:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918296:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918303:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918309:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918316:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918323:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918329:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918335:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918341:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918422:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918431:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918438:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918445:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918451:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918457:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918462:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918468:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918474:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918497:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918504:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918509:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918515:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918520:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918526:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918532:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918538:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918544:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918550:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918556:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918562:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918568:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918574:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918580:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918586:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918593:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918600:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918607:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918614:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918619:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918626:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918633:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918638:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918644:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918649:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918655:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918660:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918665:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918671:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918677:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918683:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918690:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918698:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918705:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.918719:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.925634:0:5795:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a6e0a78b400:5795] 0 exiting: rc = 1 00000100:00100000:2.0:1788917023.925831:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a6e0a78ba00:5796] 1 exiting: rc = 0 00000100:00100000:3.0:1788917023.926284:0:11923:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9a6e09e05800:11923] 2 exiting: rc = 0 00000100:00100000:0.0:1788917023.926495:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926503:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926509:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926515:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926520:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926525:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926531:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926536:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926543:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926548:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926556:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926563:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926571:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926576:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926582:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926591:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926599:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926608:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926614:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926622:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926631:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926638:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926647:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926655:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926664:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926671:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926679:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926686:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926693:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926701:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926709:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926719:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926728:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926754:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926764:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926770:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926921:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926933:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926944:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926955:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926963:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926972:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926980:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.926991:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927005:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927018:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927031:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927044:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927059:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927108:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927118:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927126:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927136:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927142:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927298:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927306:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927314:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927321:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927328:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927335:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927343:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927470:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927480:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.927489:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788917023.928527:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a6e11180600:5798] 1 exiting: rc = 0 00000100:00100000:2.0:1788917023.928529:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a6e0a735600:5797] 0 exiting: rc = 1 00000100:00100000:0.0:1788917023.928617:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928626:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928645:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928654:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928673:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928680:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928689:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928696:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928704:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928712:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928719:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928736:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928743:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928749:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928754:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928759:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928764:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928771:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928776:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928782:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928788:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928795:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928803:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928834:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.928848:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929002:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929013:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929020:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929025:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929031:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929037:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929042:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929048:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929053:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929058:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929079:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929085:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929090:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929095:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929107:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929113:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929117:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929122:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929126:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929130:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929135:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929141:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929185:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929193:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929200:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929208:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929227:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929236:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929244:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929255:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929266:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929277:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929283:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929288:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929315:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929322:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929328:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929334:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917023.929341:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942259:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a6e1118b800:5800] 1 exiting: rc = 0 00000100:00100000:3.0:1788917023.942294:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a6e11180800:5799] 0 exiting: rc = 1 00000100:00100000:1.0:1788917023.942377:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942389:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942396:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942401:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942416:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942422:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942426:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942431:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942435:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942440:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942444:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942449:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942454:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942458:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942463:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942468:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942473:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942479:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942487:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942496:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942506:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942515:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942522:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942528:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942533:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942538:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942547:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942554:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942561:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942566:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942571:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942578:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942583:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942587:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942606:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942611:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942615:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942620:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942625:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942630:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942635:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942640:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942645:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942650:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942655:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942660:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942665:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942670:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942674:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942680:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942684:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942689:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942694:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942699:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942704:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942709:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942714:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942718:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942724:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942729:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942734:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942739:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942745:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.942751:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943169:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a6e1118a800:5801] 0 exiting: rc = 1 00000100:00100000:3.0:1788917023.943181:0:5802:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a6e1118aa00:5802] 1 exiting: rc = 0 00000100:00100000:1.0:1788917023.943263:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943272:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943278:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943397:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943412:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943418:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943423:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943436:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943445:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943451:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943461:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943467:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943473:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943479:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943485:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943490:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943496:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943502:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943507:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943512:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943517:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943522:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943527:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943533:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943539:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943544:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943550:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943555:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943560:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943566:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943579:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943585:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943591:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943597:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943603:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943609:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943615:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943622:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943628:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943642:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943648:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943655:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943661:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943668:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943674:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943681:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943693:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943700:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943706:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943712:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943719:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943725:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943731:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943737:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943742:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943748:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943754:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943760:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943766:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943771:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943776:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943782:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943787:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.943884:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788917023.944279:0:5803:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a6e1118a400:5803] 0 exiting: rc = 1 00000100:00100000:3.0:1788917023.944351:0:5804:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a6e1118bc00:5804] 1 exiting: rc = 0 00000100:00100000:1.0:1788917023.944547:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944556:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944565:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944573:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944580:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944588:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944596:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944603:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944611:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944618:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944635:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944644:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944651:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944659:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944667:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944674:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944682:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944694:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944702:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944712:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944721:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944726:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944731:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944736:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944741:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944746:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944752:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944757:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944762:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944768:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944773:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944778:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944783:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944789:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944798:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.944802:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945329:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945346:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945363:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945369:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945375:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945380:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945387:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945393:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945399:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945413:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945419:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945424:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945430:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945436:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945442:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945447:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945452:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945457:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945462:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945468:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945476:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945482:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945488:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945496:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945503:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945508:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945514:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.945520:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788917023.946606:0:5805:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a6e1118ee00:5805] 0 exiting: rc = 1 00000100:00100000:0.0:1788917023.946764:0:5806:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a6e0a7fa400:5806] 1 exiting: rc = 0 00000100:00100000:0.0:1788917023.946968:0:5807:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a6e0a7fbc00:5807] 2 exiting: rc = 0 00000100:00100000:1.0:1788917023.947112:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947119:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947138:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947143:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947212:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947230:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947239:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947245:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947254:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947263:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947428:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947435:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947441:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947447:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947453:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947461:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947480:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947493:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947505:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947512:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947531:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947540:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947546:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947592:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947603:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947612:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947621:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947629:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947637:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947669:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947680:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947689:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947703:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947712:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947721:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947728:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947734:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947740:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947747:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947753:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947760:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947766:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947773:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947779:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947786:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947795:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947804:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947814:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947824:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947834:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947845:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947860:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947866:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947891:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947899:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947905:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947911:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947917:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947923:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947929:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947936:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947942:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947948:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917023.947954:0:12915:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788917023.956535:0:12915:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788917023.956549:0:12915:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788917023.956555:0:12915:0:(genops.c:907:class_export_put()) final put ffff9a6e0b4bb800/MDS_uuid 00000020:00000080:0.0:1788917023.956560:0:12915:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e0b4bb800/MDS_uuid for MDS 00000020:01000000:0.0:1788917023.956567:0:12915:0:(genops.c:442:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788917023.956692:0:12915:0:(tgt_mount.c:2273:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788917024.543291:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788917025.312357:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788917025.312370:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788917025.312373:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a6e3f62b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788917025.312380:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 416 00000100:00100000:2.0:1788917025.312381:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1788917025.312385:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788917025.312393:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a6e3f62b000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1788917025.312404:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140770688:0@lo:400:kworker.0 00000100:00100000:0.0:1788917025.312416:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e3fcbb800 x1875815140770816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788917025.312439:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788917025.312443:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788917025.312445:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a6e3fe0f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788917025.312449:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 416 00000100:00080000:0.0:1788917025.312452:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788917025.312456:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a6e3fe0f000 using connection 192.168.202.140@tcp/0@lo 00000400:00000100:2.0:1788917025.312462:0:3304:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875815140770688 offset 0 length 224: 4 00000100:00100000:0.0:1788917025.312470:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e3fcbaa00 x1875815140770944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788917025.312489:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875815140770816:0@lo:38:kworker.0 00000400:00000100:0.0:1788917025.312516:0:3303:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875815140770816 offset 0 length 520: 4 00000100:00100000:0.0:1788917025.312536:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875815140770944:0@lo:38:kworker.0 00000400:00000100:0.0:1788917025.312555:0:3303:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875815140770944 offset 0 length 520: 4 00000020:01000004:2.0:1788917025.420055:0:13072:0:(tgt_mount.c:2284:server_umount_begin()) umount -f 00000020:01000004:2.0:1788917025.429380:0:13072:0:(tgt_mount.c:2144:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788917025.429439:0:13072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2000/0x51de7f756a83d6e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d6e9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917025.429472:0:13072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2000/0x51de7f756a83d6e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d6e9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917025.429480:0:13072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2000/0x51de7f756a83d6e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d6e9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917025.429487:0:13072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2000/0x51de7f756a83d6e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d6e9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917025.429545:0:13072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788917025.429551:0:13072:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788917025.429574:0:13072:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788917025.429587:0:13072:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6e3fcbb800 x1875815140770816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788917040 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788917025.429604:0:13072:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788917025.429610:0:13072:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788917025.429616:0:13072:0:(import.c:65:import_set_state_nolock()) ffff9a6e3f62b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788917025.429620:0:13072:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788917025.429624:0:13072:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6e3fcbb800 x1875815140770816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788917040 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788917025.429631:0:13072:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788917025.429634:0:13072:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788917025.429659:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875815140770816:0@lo:38:kworker.0 00010000:00010000:0.0:1788917025.430134:0:12916:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788917025.430141:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2000/0x51de7f756a83d6e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d6e9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917025.430183:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2000 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:0.0:1788917025.430195:0:12916:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2000/0x51de7f756a83d6e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d6e9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917025.430215:0:12916:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2000/0x51de7f756a83d6e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x51de7f756a83d6e9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788917025.430223:0:12916:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2000/0x51de7f756a83d6e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x51de7f756a83d6e9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788917025.430230:0:12916:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788917025.430236:0:12916:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788917025.430238:0:12916:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788917025.430279:0:12916:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2000/0x51de7f756a83d6e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d6e9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917025.430286:0:12916:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788917025.430315:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2000/0x51de7f756a83d6e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d6e9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917025.430325:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2000/0x51de7f756a83d6e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d6e9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917025.430330:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788917025.430348:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4933373a-b540-4420-bf34-9071e19d7373:3307:1875815140771072:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788917025.430396:0:12916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917025.430400:0:12916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917025.430401:0:12916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917025.430426:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917025.430467:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140771072 00000100:00100000:0.0:1788917025.430475:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140771072 00000100:00100000:0.0:1788917025.430533:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788917025.430541:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e408e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3307:x1875815140771072:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788917025.430549:0:5778:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788917025 with bad export cookie 5899292704176853963 00010000:00010000:2.0:1788917025.431083:0:13072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab800/0x51de7f756a83d6f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d6f7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917025.431092:0:13072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab800/0x51de7f756a83d6f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d6f7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917025.431096:0:13072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab800/0x51de7f756a83d6f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d6f7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917025.431099:0:13072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab800/0x51de7f756a83d6f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d6f7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917025.431113:0:13072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788917025.431119:0:13072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d912 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d919 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917025.431134:0:13072:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d912 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d919 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917025.431142:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788917025.431142:0:13072:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d912 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d919 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917025.431167:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab800/0x51de7f756a83d6f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d6f7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917025.431176:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab800 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1788917025.431180:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab800/0x51de7f756a83d6f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d6f7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917025.431188:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab800/0x51de7f756a83d6f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x51de7f756a83d6f7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917025.431212:0:13072:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d912 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d919 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788917025.431220:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab800/0x51de7f756a83d6f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x51de7f756a83d6f7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788917025.431228:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788917025.431230:0:13072:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788917025.431231:0:5780:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788917025.431237:0:13072:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1788917025.431241:0:13072:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:1.0:1788917025.431250:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917025.431252:0:5780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab800/0x51de7f756a83d6f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d6f7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917025.431256:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d912 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d919 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788917025.431257:0:13072:0:(tgt_mount.c:2204:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788917025.431263:0:13072:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788917025.431269:0:13072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1788917025.431270:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f000 already unused, calling callback (ffffffffc1d46c20) 00000020:00000080:2.0:1788917025.431274:0:13072:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 10000000:00010000:1.0:1788917025.431276:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d912 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d919 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788917025.431279:0:13072:0:(genops.c:1587:class_disconnect_exports()) OBD device 11 (ffff9a6e0b5c99c0) has no exports 00010000:00010000:1.0:1788917025.431290:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d912 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x51de7f756a83d919 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788917025.431297:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d912 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x51de7f756a83d919 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788917025.431300:0:13072:0:(genops.c:1587:class_disconnect_exports()) OBD device 11 (ffff9a6e0b5c99c0) has no exports 10000000:01000000:1.0:1788917025.431301:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788917025.431314:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788917025.431317:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788917025.431335:0:5780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788917025.431342:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d912 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d919 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917025.431350:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788917025.431355:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab800/0x51de7f756a83d6f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d6f7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917025.431375:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab800/0x51de7f756a83d6f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d6f7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917025.431379:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d912 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d919 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917025.431387:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917025.431389:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83d912 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x51de7f756a83d919 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917025.431391:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917025.431395:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917025.431403:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788917025.431408:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917025.431412:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917025.431414:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917025.431416:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140771200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788917025.431452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917025.431507:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140771200 00000100:00100000:3.0:1788917025.431512:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140771200 00000100:00100000:3.0:1788917025.431538:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788917025.431545:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3306:x1875815140771200:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788917025.431552:0:5779:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788917025 with bad export cookie 5899292704176853963 00000100:00100000:3.0:1788917025.431601:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3306:x1875815140771200:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (146us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788917025.431609:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788917025.431650:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.140@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788917025.431656:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a6e052ef000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788917025.431661:0:3306:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:2.0:1788917025.433012:0:13072:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a6e2d1c0600 - data ffff9a6e3f94cbd0/ffff9a6e3726f000 00000020:01000000:2.0:1788917025.433136:0:13072:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a6e1ecd2240 - data ffff9a6d014c8d80/ffff9a6e3f5e1400 00000100:00080000:3.0:1788917025.440631:0:3306:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.140@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788917025.440637:0:3306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788917025.440648:0:3306:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6e3fcba300 x1875815140770688/t0(0) o400->MGC192.168.202.140@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788917041 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788917025.440663:0:3306:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6e3fcb9f80 x1875815140771072/t0(0) o103->MGC192.168.202.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788917041 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788917025.440701:0:3306:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6e37135f80 x1875815140771200/t0(0) o103->MGC192.168.202.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788917041 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788917025.440715:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788917025.440717:0:3306:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788917025.440719:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788917025.440721:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:0:1875815140771328:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788917025.440723:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a6e052ef000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788917025.440730:0:3306:0:(import.c:510:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 0@lo last attempt 201 00000100:00080000:3.0:1788917025.440737:0:3306:0:(import.c:624:import_select_connection()) MGC192.168.202.140@tcp: import ffff9a6e052ef000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1788917025.440768:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4933373a-b540-4420-bf34-9071e19d7373:3307:1875815140771072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788917025.440824:0:3306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e37137b80 x1875815140771456/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788917025.440865:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4933373a-b540-4420-bf34-9071e19d7373:3303:1875815140771456:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1788917025.440917:0:3303:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875815140771456 offset 0 length 520: 4 00000100:00100000:1.0:1788917025.440944:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4933373a-b540-4420-bf34-9071e19d7373:3304:1875815140770688:0@lo:400:kworker.0 00000100:00100000:3.0:1788917025.440972:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4933373a-b540-4420-bf34-9071e19d7373:3306:1875815140771200:0@lo:103:ldlm_bl.0 00000400:00000100:0.0:1788917025.443539:0:5778:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875815140771072 offset 224 length 224: 4 00000100:00100000:0.0:1788917025.443576:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e408e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3307:x1875815140771072:12345-0@lo:103:ldlm_bl.0 Request processed in 13033us (13149us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788917025.443587:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00100000:10000000:2.0:1788917025.458567:0:13072:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788917025.471764:0:13072:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d4ff 00000020:00000080:0.0:1788917025.471774:0:13072:0:(genops.c:907:class_export_put()) final put ffff9a6e36a37000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788917025.471798:0:13072:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6e2c984800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788917025.471802:0:13072:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6e2c984800 2 00000020:01000004:0.0:1788917025.471805:0:13072:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a6e2c984800 from lustre-OST0000 00000020:00000080:0.0:1788917025.471827:0:13072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788917025.471838:0:13072:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788917025.471841:0:13072:0:(genops.c:907:class_export_put()) final put ffff9a6e36a37800/lustre-OST0000_UUID 00000020:00000080:0.0:1788917025.471843:0:13072:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e36a37800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788917025.471849:0:13072:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788917025.471894:0:13072:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788917025.471899:0:13072:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788917025.471903:0:13072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788917025.471907:0:13072:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788917025.471915:0:13072:0:(genops.c:1848:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a6e3f62f800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788917025.471922:0:13072:0:(genops.c:1582:class_disconnect_exports()) OBD device 12 (ffff9a6e1fe94d40) has exports, disconnecting them 00000020:00080000:0.0:1788917025.471927:0:13072:0:(genops.c:1557:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a6e3f62f800), last request at 1788916828 00000020:00000080:0.0:1788917025.471931:0:13072:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d529 00000020:00080000:0.0:1788917025.471939:0:13072:0:(genops.c:1562:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6e3f62f800): rc 0 00000020:00000080:0.0:1788917025.471944:0:13072:0:(genops.c:907:class_export_put()) final put ffff9a6e3f62f800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788917025.472270:0:8:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e36a37000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788917025.472278:0:8:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e3f62f800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788917025.475100:0:13072:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788917025.475118:0:13072:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788917025.475123:0:13072:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788917025.475129:0:13072:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788917025.475182:0:8:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e3f62b000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788917025.475324:0:13072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788917025.475331:0:13072:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788917025.475336:0:13072:0:(genops.c:907:class_export_put()) final put ffff9a6e3f62c800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788917025.475351:0:13072:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e3f62c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788917025.475360:0:13072:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788917025.475409:0:13072:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6e2c984800 1 00000020:00000080:0.0:1788917025.475416:0:13072:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d4b9 00000020:00000080:0.0:1788917025.475422:0:13072:0:(genops.c:907:class_export_put()) final put ffff9a6e1ecfd000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788917025.475439:0:13072:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788917025.475443:0:13072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788917025.475448:0:13072:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788917025.475452:0:13072:0:(genops.c:1587:class_disconnect_exports()) OBD device 9 (ffff9a6e1fe919c0) has no exports 00000020:00000080:1.0:1788917025.475470:0:8:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e1ecfd000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788917025.486597:0:13072:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788917025.486615:0:13072:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788917025.486623:0:13072:0:(genops.c:907:class_export_put()) final put ffff9a6e2c9fc800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788917025.486629:0:13072:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e2c9fc800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788917025.486637:0:13072:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788917025.486920:0:13072:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a6e2c984000 00000020:02000400:0.0:1788917025.487016:0:13072:0:(tgt_mount.c:2273:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788917025.568265:0:12916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917026.591859:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788917026.752688:0:13223:0:(tgt_mount.c:2284:server_umount_begin()) umount -f 00000020:01000004:2.0:1788917026.762348:0:13223:0:(tgt_mount.c:2144:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788917026.762421:0:13223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83d6c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d6cd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917026.762434:0:13223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83d6c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d6cd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917026.762452:0:13223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83d6c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d6cd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917026.762459:0:13223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83d6c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d6cd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917026.762478:0:13223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788917026.762483:0:13223:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1788917026.762498:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788917026.762507:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83d6c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d6cd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788917026.762514:0:13223:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:1.0:1788917026.762517:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeabc00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:1.0:1788917026.762525:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83d6c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d6cd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917026.762529:0:13223:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6e3fcbaa00 x1875815140770944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788917040 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788917026.762538:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83d6c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x51de7f756a83d6cd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917026.762552:0:13223:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788917026.762559:0:13223:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 10000000:00010000:1.0:1788917026.762563:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83d6c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x51de7f756a83d6cd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788917026.762566:0:13223:0:(import.c:65:import_set_state_nolock()) ffff9a6e3fe0f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788917026.762572:0:13223:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:01000000:1.0:1788917026.762573:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788917026.762577:0:13223:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6e3fcbaa00 x1875815140770944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788917040 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788917026.762578:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788917026.762583:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1788917026.762588:0:13223:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788917026.762591:0:13223:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00010000:00010000:1.0:1788917026.762601:0:5781:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a6e052ef000 00000100:00100000:3.0:1788917026.762605:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875815140770944:0@lo:38:kworker.0 00010000:00010000:1.0:1788917026.762607:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83d6c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x51de7f756a83d6cd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917026.762616:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83d6c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x51de7f756a83d6cd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917026.762627:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917026.762630:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917026.762633:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917026.763351:0:13223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f200/0x51de7f756a83d6d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d6db expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917026.763361:0:13223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f200/0x51de7f756a83d6d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d6db expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917026.763368:0:13223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f200/0x51de7f756a83d6d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d6db expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917026.763385:0:13223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f200/0x51de7f756a83d6d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d6db expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917026.763401:0:13223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788917026.763406:0:13223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83d904 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83d90b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917026.763411:0:13223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83d904 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83d90b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917026.763415:0:13223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83d904 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d90b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917026.763418:0:13223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83d904 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x51de7f756a83d90b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917026.763425:0:13223:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788917026.763428:0:13223:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:0.0:1788917026.763433:0:12916:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788917026.763441:0:12916:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f200/0x51de7f756a83d6d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d6db expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788917026.763442:0:13223:0:(tgt_mount.c:2204:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788917026.763447:0:13223:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788917026.763452:0:13223:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1788917026.763456:0:12916:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0149f200 already unused, calling callback (ffffffffc1d46c20) 00010000:00010000:3.0:1788917026.763458:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00000080:2.0:1788917026.763458:0:13223:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 10000000:00010000:0.0:1788917026.763462:0:12916:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f200/0x51de7f756a83d6d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d6db expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788917026.763463:0:13223:0:(genops.c:1587:class_disconnect_exports()) OBD device 15 (ffff9a6e2cd08000) has no exports 00010000:00010000:3.0:1788917026.763467:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83d904 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d90b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917026.763480:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18ec00 already unused, calling callback (ffffffffc1d46c20) 00000020:00080000:2.0:1788917026.763483:0:13223:0:(genops.c:1587:class_disconnect_exports()) OBD device 15 (ffff9a6e2cd08000) has no exports 10000000:00010000:3.0:1788917026.763486:0:5780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83d904 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x51de7f756a83d90b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917026.763488:0:12916:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f200/0x51de7f756a83d6d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x51de7f756a83d6db expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917026.763507:0:5780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83d904 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x51de7f756a83d90b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788917026.763508:0:12916:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f200/0x51de7f756a83d6d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x51de7f756a83d6db expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788917026.763515:0:12916:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788917026.763529:0:12916:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788917026.763533:0:12916:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:00010000:3.0:1788917026.763536:0:5780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83d904 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x51de7f756a83d90b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788917026.763542:0:5780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788917026.763544:0:5780:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788917026.763544:0:12916:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a6e052ef000 10000000:01000000:3.0:1788917026.763549:0:5780:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788917026.763551:0:12916:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f200/0x51de7f756a83d6d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x51de7f756a83d6db expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917026.763560:0:12916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e0149f200/0x51de7f756a83d6d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x51de7f756a83d6db expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917026.763564:0:5780:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a6e052ef000 00010000:00010000:3.0:1788917026.763572:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83d904 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x51de7f756a83d90b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917026.763573:0:12916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917026.763577:0:12916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917026.763580:0:12916:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917026.763583:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83d904 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x51de7f756a83d90b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917026.763600:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917026.763602:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917026.763604:0:5780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788917026.764942:0:13223:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a6e2d1c01e0 - data ffff9a6e3f8b9288/ffff9a6e3647a800 00000020:01000000:2.0:1788917026.765091:0:13223:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a6e09948000 - data ffff9a6e3f86e6c0/ffff9a6e3a3f6c00 00100000:10000000:2.0:1788917026.780047:0:13223:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788917026.795640:0:13223:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d5ca 00000020:00000080:2.0:1788917026.795658:0:13223:0:(genops.c:907:class_export_put()) final put ffff9a6e2d1a7000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788917026.795670:0:13223:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6e3f439800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788917026.795673:0:13223:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6e3f439800 2 00000020:01000004:2.0:1788917026.795676:0:13223:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a6e3f439800 from lustre-OST0001 00000020:00000080:2.0:1788917026.795698:0:13223:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788917026.795708:0:13223:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788917026.795710:0:13223:0:(genops.c:907:class_export_put()) final put ffff9a6e2d1a1800/lustre-OST0001_UUID 00000020:00000080:2.0:1788917026.795713:0:13223:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e2d1a1800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788917026.795719:0:13223:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:1.0:1788917026.795777:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e2d1a7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1788917026.795893:0:13223:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 4933373a-b540-4420-bf34-9071e19d7373->MGS 00010000:00010000:2.0:1788917026.795909:0:13223:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc800/0x51de7f756a83d4dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x51de7f756a83d4e3 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788917026.795922:0:13223:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc800/0x51de7f756a83d4dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x51de7f756a83d4e3 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788917026.795929:0:13223:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788917026.795932:0:13223:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788917026.795936:0:13223:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788917026.795968:0:13223:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a6e052ef000 00010000:00010000:2.0:1788917026.795973:0:13223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e013fc800/0x51de7f756a83d4dc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x51de7f756a83d4e3 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917026.795991:0:13223:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2400/0x51de7f756a83d71a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x51de7f756a83d721 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788917026.795999:0:13223:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2400/0x51de7f756a83d71a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x51de7f756a83d721 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788917026.796005:0:13223:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788917026.796007:0:13223:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788917026.796009:0:13223:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788917026.796035:0:13223:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a6e052ef000 00010000:00010000:2.0:1788917026.796039:0:13223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2400/0x51de7f756a83d71a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x51de7f756a83d721 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788917026.796544:0:13223:0:(import.c:65:import_set_state_nolock()) ffff9a6e052ef000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788917026.796549:0:13223:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788917026.796552:0:13223:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788917026.796554:0:13223:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788917026.796558:0:13223:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788917026.796570:0:13223:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6e37137b80 x1875815140771456/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788917035 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788917026.796595:0:13223:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788917026.796599:0:13223:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00000100:00100000:1.0:1788917026.796668:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4933373a-b540-4420-bf34-9071e19d7373:3303:1875815140771456:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:2.0:1788917026.796727:0:13223:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788917026.796740:0:13223:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d3bd 00000020:00000080:2.0:1788917026.796749:0:13223:0:(genops.c:907:class_export_put()) final put ffff9a6e0b4bf000/4933373a-b540-4420-bf34-9071e19d7373 00000020:01000000:2.0:1788917026.796766:0:13223:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.140@tcp (flags='') 00000020:00000080:2.0:1788917026.796771:0:13223:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788917026.796776:0:13223:0:(obd_config.c:955:class_cleanup()) MGC192.168.202.140@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788917026.796780:0:13223:0:(genops.c:1587:class_disconnect_exports()) OBD device 2 (ffff9a6e0a73b380) has no exports 10000000:01000000:0.0:1788917026.796816:0:5789:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788917026.796851:0:13223:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.140@tcp: client import never connected 00000100:00080000:2.0:1788917026.796860:0:13223:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788917026.796862:0:13223:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788917026.796865:0:13223:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788917026.796868:0:13223:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788917026.796879:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e0b4bf000/4933373a-b540-4420-bf34-9071e19d7373 for MGC192.168.202.140@tcp 00000020:00000080:0.0:1788917026.796898:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e052ef000 for MGC192.168.202.140@tcp 00000020:00000080:2.0:1788917026.796922:0:13223:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788917026.796928:0:13223:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.140@tcp (uuid 4933373a-b540-4420-bf34-9071e19d7373) 00000020:00000080:2.0:1788917026.796932:0:13223:0:(genops.c:907:class_export_put()) final put ffff9a6e052ee000/4933373a-b540-4420-bf34-9071e19d7373 00000020:00000080:2.0:1788917026.796934:0:13223:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e052ee000/4933373a-b540-4420-bf34-9071e19d7373 for MGC192.168.202.140@tcp 00000020:01000000:2.0:1788917026.796939:0:13223:0:(genops.c:442:class_free_dev()) finishing cleanup of obd MGC192.168.202.140@tcp (4933373a-b540-4420-bf34-9071e19d7373) 00000020:01000000:2.0:1788917026.797312:0:13223:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788917026.797316:0:13223:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788917026.797327:0:13223:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788917026.797332:0:13223:0:(genops.c:1848:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a6e3fe09800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788917026.797337:0:13223:0:(genops.c:1582:class_disconnect_exports()) OBD device 16 (ffff9a6e0b5ccd40) has exports, disconnecting them 00000020:00080000:2.0:1788917026.797342:0:13223:0:(genops.c:1557:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a6e3fe09800), last request at 1788916852 00000020:00000080:2.0:1788917026.797346:0:13223:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d5f4 00000020:00080000:2.0:1788917026.797357:0:13223:0:(genops.c:1562:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6e3fe09800): rc 0 00000020:00000080:2.0:1788917026.797361:0:13223:0:(genops.c:907:class_export_put()) final put ffff9a6e3fe09800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788917026.797381:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e3fe09800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788917026.800986:0:13223:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788917026.800995:0:13223:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788917026.800999:0:13223:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788917026.801006:0:13223:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788917026.801118:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e3fe0f000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788917026.801135:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788917026.801248:0:12916:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788917026.803597:0:5780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788917026.803729:0:5776:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a6e0759da00:5776] 1 exiting: rc = 0 00000100:00100000:1.0:1788917026.804109:0:5775:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a6e0759d400:5775] 0 exiting: rc = 1 00000100:00100000:0.0:1788917026.804203:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.804499:0:5778:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a6e08b30800:5778] 1 exiting: rc = 0 00000100:00100000:1.0:1788917026.804652:0:6606:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a6e3f422400:6606] 3 exiting: rc = 0 00000100:00100000:3.0:1788917026.805085:0:5779:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a6e1edd3600:5779] 2 exiting: rc = 0 00000100:00100000:3.0:1788917026.805183:0:5777:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a6e0759cc00:5777] 0 exiting: rc = 1 00000100:00100000:0.0:1788917026.805318:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.805956:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.805966:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.805976:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.805981:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.805992:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.805999:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806008:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806027:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806033:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806040:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806046:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806051:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806059:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806067:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806074:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806080:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806087:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806096:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806106:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806116:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806121:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806127:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806133:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806165:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806172:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806177:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806183:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806199:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806207:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806213:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806219:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806225:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806231:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806236:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806243:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806252:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806263:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806269:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806274:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806280:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806286:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806291:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806304:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806309:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806314:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806320:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806325:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806330:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806335:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806340:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806344:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806350:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806356:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806360:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806365:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806371:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806377:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806383:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806388:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806393:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806399:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806404:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.806408:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788917026.807288:0:13223:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788917026.807299:0:13223:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788917026.807304:0:13223:0:(genops.c:907:class_export_put()) final put ffff9a6e09920000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788917026.807309:0:13223:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e09920000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788917026.807314:0:13223:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788917026.807358:0:13223:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6e3f439800 1 00000020:00000080:0.0:1788917026.807365:0:13223:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83d599 00000020:00000080:0.0:1788917026.807371:0:13223:0:(genops.c:907:class_export_put()) final put ffff9a6e0b47d000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788917026.807412:0:13223:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788917026.807417:0:13223:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788917026.807421:0:13223:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788917026.807425:0:13223:0:(genops.c:1587:class_disconnect_exports()) OBD device 14 (ffff9a6e0a77b380) has no exports 00000020:00000080:1.0:1788917026.807740:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e0b47d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788917026.820998:0:13223:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788917026.821014:0:13223:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788917026.821020:0:13223:0:(genops.c:907:class_export_put()) final put ffff9a6e0a780000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788917026.821025:0:13223:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e0a780000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788917026.821032:0:13223:0:(genops.c:442:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788917026.821279:0:13223:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a6e3f438800 00000020:01000000:2.0:1788917026.821302:0:13223:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788917026.821306:0:13223:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788917026.821310:0:13223:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788917026.821315:0:13223:0:(genops.c:1587:class_disconnect_exports()) OBD device 10 (ffff9a6e2cd0cd40) has no exports 00000020:00000080:2.0:1788917026.821345:0:13223:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788917026.821351:0:13223:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788917026.821354:0:13223:0:(genops.c:907:class_export_put()) final put ffff9a6e1ecfb800/OSS_uuid 00000020:00000080:2.0:1788917026.821356:0:13223:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e1ecfb800/OSS_uuid for OSS 00000020:01000000:2.0:1788917026.821359:0:13223:0:(genops.c:442:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788917026.821846:0:5788:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788917026.821978:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a6e09fdb200:6590] 0 exiting: rc = 1 00000100:00100000:0.0:1788917026.822029:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a6e06965000:6593] 2 exiting: rc = 0 00000100:00100000:1.0:1788917026.822111:0:6592:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a6e08217000:6592] 1 exiting: rc = 0 00000100:00100000:2.0:1788917026.823292:0:8068:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a6e3fe07400:8068] 3 exiting: rc = 0 00000100:00100000:0.0:1788917026.823418:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823432:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823440:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823463:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823471:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823479:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823488:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823498:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823509:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823516:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823524:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823532:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823539:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823547:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823554:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823561:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823569:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823574:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823586:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823591:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823605:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823612:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823620:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823631:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823637:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823642:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823647:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823651:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823655:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823659:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823663:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823667:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823671:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823690:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823698:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823705:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823712:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823718:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823726:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823734:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823743:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823751:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823759:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823767:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823774:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823781:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823789:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823796:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823803:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823810:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823814:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823819:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823823:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823833:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823838:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823843:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823848:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823854:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823860:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823865:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823870:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823878:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823895:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.823904:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788917026.825178:0:6595:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a6e09ebf200:6595] 1 exiting: rc = 0 00000100:00100000:1.0:1788917026.825340:0:6594:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a6e082b7a00:6594] 0 exiting: rc = 1 00000100:00100000:0.0:1788917026.825938:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.825951:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.825959:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.825966:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.825992:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826001:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826010:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826018:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826026:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826034:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826043:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826051:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826058:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826066:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826075:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826085:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826092:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826100:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826108:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826117:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826125:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826133:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826162:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826176:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826185:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826208:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826217:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826230:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826239:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826248:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826257:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826266:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826276:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826286:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826296:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826306:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826338:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826359:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826372:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826389:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826399:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826409:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826422:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826430:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826435:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826441:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826446:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826457:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826466:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826474:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826486:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826490:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826495:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826498:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826502:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826506:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826509:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826512:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826515:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826518:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826524:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826527:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826530:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.826534:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788917026.828385:0:6598:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a6e0a7fba00:6598] 2 exiting: rc = 0 00000100:00100000:2.0:1788917026.828651:0:6597:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a6e0a7fa000:6597] 1 exiting: rc = 0 00000100:00100000:3.0:1788917026.829456:0:6596:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a6e0a7fac00:6596] 0 exiting: rc = 1 00000100:00100000:1.0:1788917026.829588:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829607:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829613:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829619:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829625:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829630:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829636:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829642:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829647:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829652:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829657:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829663:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829682:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829688:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829703:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829709:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829714:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829720:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829819:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829828:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829835:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829840:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829846:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829851:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829857:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829862:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829867:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829873:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829879:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829884:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829889:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829896:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829902:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829908:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829914:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829919:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829946:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829952:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829958:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829965:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829971:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829976:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829982:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829988:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.829994:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830001:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830007:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830012:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830019:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830025:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830031:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830036:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830051:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830057:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830063:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830070:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830076:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830082:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830088:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830093:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830099:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830105:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830111:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.830117:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788917026.838970:0:6599:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a6e0a7fb600:6599] 0 exiting: rc = 1 00000100:00100000:2.0:1788917026.838971:0:6600:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a6e1edce400:6600] 1 exiting: rc = 0 00000100:00100000:0.0:1788917026.839079:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839088:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839093:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839098:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839103:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839108:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839114:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839121:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839126:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839131:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839161:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839165:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839169:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839173:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839176:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839179:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839183:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839186:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839202:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839206:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839209:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839213:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839217:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839221:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839268:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839275:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839280:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839285:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839289:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839295:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839300:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839305:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839310:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839316:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839321:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839326:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839331:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839336:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839340:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839345:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839350:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839355:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839362:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839370:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839377:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839393:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839398:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839402:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839407:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839413:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839417:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839423:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839428:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839433:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839439:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839445:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839449:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839454:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839459:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839464:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839470:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839475:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839480:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.839491:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788917026.840250:0:6602:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a6e36713400:6602] 1 exiting: rc = 0 00000100:00100000:2.0:1788917026.840286:0:6601:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a6e09e12000:6601] 0 exiting: rc = 1 00000100:00100000:0.0:1788917026.840360:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840372:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840380:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840395:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840402:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840410:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840418:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840427:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840437:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840444:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840449:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840455:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840475:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840483:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840491:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840498:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840513:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840519:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840525:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840530:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840534:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840538:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840542:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840545:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840559:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840564:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840568:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840572:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840579:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840585:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840590:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840596:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840602:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840608:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840614:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840620:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840642:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840649:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840655:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840661:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840666:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840672:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840676:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840682:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840687:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840693:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840698:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840704:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840723:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840730:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840736:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840748:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840754:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840760:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840766:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840772:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840779:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840785:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840791:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840797:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840818:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840825:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840831:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788917026.840836:0:13223:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788917026.853373:0:13223:0:(tgt_mount.c:2273:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788917037.629339:0:13834:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788917043.047048:0:14247:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788917043.047058:0:14247:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788917043.047245:0:14247:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a6e05362800 00000020:01000004:2.0:1788917043.047270:0:14247:0:(tgt_mount.c:2592:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788917043.047279:0:14247:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788917043.047295:0:14247:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a6e0b5ccd40) 00000020:00000080:2.0:1788917043.047307:0:14247:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788917043.064323:0:14247:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788917043.066435:0:14247:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788917043.066705:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 385: rc = 0 00100000:10000000:2.0:1788917043.066795:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 385: rc = 0 00100000:10000000:2.0:1788917043.066857:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 385: rc = 0 00100000:10000000:2.0:1788917043.067004:0:14247:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788917043.067087:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 385: rc = 0 00100000:10000000:2.0:1788917043.067457:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 385: rc = 0 00100000:10000000:2.0:1788917043.067524:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 385: rc = 0 00100000:10000000:2.0:1788917043.067721:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 387: rc = 0 00100000:10000000:2.0:1788917043.068769:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 339: rc = 0 00100000:10000000:2.0:1788917043.068874:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 339: rc = 0 00100000:10000000:2.0:1788917043.070945:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 642: rc = 0 00100000:10000000:2.0:1788917043.071313:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:2.0:1788917043.071572:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 642: rc = 0 00100000:10000000:2.0:1788917043.071810:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:2.0:1788917043.072083:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 642: rc = 0 00100000:10000000:2.0:1788917043.072819:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:2.0:1788917043.073123:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 642: rc = 0 00100000:10000000:2.0:1788917043.073515:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 642: rc = 0 00100000:10000000:2.0:1788917043.073768:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 642: rc = 0 00100000:10000000:2.0:1788917043.074001:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 642: rc = 0 00100000:10000000:2.0:1788917043.074433:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 642: rc = 0 00100000:10000000:2.0:1788917043.074701:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 642: rc = 0 00100000:10000000:2.0:1788917043.075230:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 351: rc = 0 00100000:10000000:2.0:1788917043.075527:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 351: rc = 0 00100000:10000000:2.0:1788917043.075807:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 351: rc = 0 00100000:10000000:2.0:1788917043.076173:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 351: rc = 0 00100000:10000000:2.0:1788917043.076450:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 351: rc = 0 00100000:10000000:2.0:1788917043.076722:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 351: rc = 0 00100000:10000000:2.0:1788917043.076970:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 351: rc = 0 00100000:10000000:2.0:1788917043.077479:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 351: rc = 0 00100000:10000000:2.0:1788917043.077740:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 351: rc = 0 00100000:10000000:2.0:1788917043.078189:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 351: rc = 0 00100000:10000000:2.0:1788917043.078407:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 351: rc = 0 00100000:10000000:2.0:1788917043.078607:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 351: rc = 0 00100000:10000000:2.0:1788917043.078800:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 351: rc = 0 00100000:10000000:2.0:1788917043.078992:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 351: rc = 0 00100000:10000000:2.0:1788917043.079270:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 351: rc = 0 00100000:10000000:2.0:1788917043.079495:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 351: rc = 0 00100000:10000000:2.0:1788917043.079759:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 351: rc = 0 00100000:10000000:2.0:1788917043.080049:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 351: rc = 0 00100000:10000000:2.0:1788917043.080376:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 351: rc = 0 00100000:10000000:2.0:1788917043.080650:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 351: rc = 0 00100000:10000000:2.0:1788917043.080900:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 351: rc = 0 00100000:10000000:2.0:1788917043.081347:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 351: rc = 0 00100000:10000000:2.0:1788917043.081638:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 351: rc = 0 00100000:10000000:2.0:1788917043.081924:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 351: rc = 0 00100000:10000000:2.0:1788917043.082322:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 351: rc = 0 00100000:10000000:2.0:1788917043.082640:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 351: rc = 0 00100000:10000000:2.0:1788917043.082975:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 351: rc = 0 00100000:10000000:2.0:1788917043.083576:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 351: rc = 0 00100000:10000000:2.0:1788917043.083830:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 351: rc = 0 00100000:10000000:2.0:1788917043.084123:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 351: rc = 0 00100000:10000000:3.0:1788917043.086475:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 351: rc = 0 00100000:10000000:3.0:1788917043.086839:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 351: rc = 0 00100000:10000000:3.0:1788917043.087246:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 650: rc = 0 00100000:10000000:3.0:1788917043.088966:0:14247:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788917043.089198:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 340: rc = 0 00100000:10000000:3.0:1788917043.089396:0:14247:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788917043.089473:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 340: rc = 0 00100000:10000000:3.0:1788917043.089678:0:14247:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788917043.089744:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 340: rc = 0 00100000:10000000:3.0:1788917043.090620:0:14247:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788917043.090696:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 343: rc = 0 00100000:10000000:3.0:1788917043.090907:0:14247:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788917043.090972:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 343: rc = 0 00100000:10000000:3.0:1788917043.091201:0:14247:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788917043.091270:0:14247:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 343: rc = 0 00000020:00000080:3.0:1788917043.092768:0:14247:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788917043.092779:0:14247:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788917043.092795:0:14247:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x51de7f756a83e6be 00000020:01000004:3.0:1788917043.092806:0:14247:0:(tgt_mount.c:2677:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788917043.092812:0:14247:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788917043.092818:0:14247:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a6e05362800 from MGS 00000020:01000004:3.0:1788917043.092823:0:14247:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788917043.092838:0:14247:0:(genops.c:414:class_newdev()) Allocate new device MGS (ffff9a6e2cd0b380) 00000020:00000080:3.0:1788917043.092852:0:14247:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788917043.092928:0:14247:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6e05362800 from MGS, refs=2 00080000:01000000:3.0:1788917043.092933:0:14247:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788917043.092940:0:14247:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x51de7f756a83e6cc 00000100:00100000:3.0:1788917043.093078:0:14247:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788917043.093263:0:14247:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788917043.093270:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788917043.094232:0:14247:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788917043.094242:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788917043.097336:0:14247:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788917043.097847:0:14247:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788917043.097854:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788917043.099077:0:14247:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788917043.099088:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788917043.099505:0:14247:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788917043.099511:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788917043.104805:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917043.104814:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917043.104816:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917043.105188:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917043.105191:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917043.105194:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917043.105940:0:14247:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788917043.110676:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788917043.117318:0:14247:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788917043.117350:0:14247:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788917043.117354:0:14247:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788917043.120847:0:14256:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788917043.121172:0:14247:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788917043.121284:0:14247:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788917043.122090:0:14247:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788917043.122504:0:14247:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788917043.122989:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788917043.122996:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788917043.124127:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788917043.124138:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788917043.124725:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788917043.124733:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788917043.127216:0:14247:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788917043.127243:0:14247:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.140@tcp' 00000020:01000004:3.0:1788917043.127246:0:14247:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788917043.127282:0:14247:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.140@tcp (typ=mgc) 00000020:00000080:3.0:1788917043.127298:0:14247:0:(genops.c:414:class_newdev()) Allocate new device MGC192.168.202.140@tcp (ffff9a6e2cd0cd40) 00000020:00000080:3.0:1788917043.127318:0:14247:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788917043.127416:0:14247:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6e36a34800@MGC192.168.202.140@tcp: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1788917043.127631:0:14247:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.140@tcp-0 is initialized 00000100:00080000:0.0:1788917043.127776:0:14261:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000040:01000000:3.0:1788917043.127862:0:14247:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788917043.130069:0:14262:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788917043.132062:0:14247:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.140@tcp (uuid cd2b9984-a8d8-4aee-bfd2-3bebf748d575) 00000020:00000080:1.0:1788917043.132097:0:14247:0:(genops.c:1407:class_connect()) connect: client cd2b9984-a8d8-4aee-bfd2-3bebf748d575, cookie 0x51de7f756a83e6da 00000100:00080000:1.0:1788917043.132113:0:14247:0:(import.c:510:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788917043.132123:0:14247:0:(import.c:624:import_select_connection()) MGC192.168.202.140@tcp: import ffff9a6e36a34800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1788917043.132211:0:14247:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e3a681880 x1875815140771584/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788917043.132246:0:14247:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cd2b9984-a8d8-4aee-bfd2-3bebf748d575->MGS 00000020:01000004:1.0:1788917043.132275:0:14247:0:(tgt_mount.c:1890:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:0.0:1788917043.132294:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3303:1875815140771584:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788917043.132384:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917043.132443:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140771584 00000100:00100000:2.0:1788917043.132451:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140771584 00000100:00100000:2.0:1788917043.132488:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788917043.132497:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1875815140771584:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788917043.132525:0:14257:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from cd2b9984-a8d8-4aee-bfd2-3bebf748d575@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:01000004:1.0:1788917043.132620:0:14247:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788917043.132636:0:14247:0:(genops.c:414:class_newdev()) Allocate new device MDS (ffff9a6e0a778000) 00000020:00000080:2.0:1788917043.132732:0:14257:0:(genops.c:1407:class_connect()) connect: client cd2b9984-a8d8-4aee-bfd2-3bebf748d575, cookie 0x51de7f756a83e6e1 00000020:00000080:1.0:1788917043.133088:0:14247:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:2.0:1788917043.133488:0:14257:0:(import.c:65:import_set_state_nolock()) ffff9a6e0a7c4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788917043.133601:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+5:3303:x1875815140771584:12345-0@lo:250:mount.lustre.0 Request processed in 1102us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917043.133615:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788917043.133719:0:3303:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.140@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788917043.133732:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.140@tcp: connect to target with instance 0 00000100:00080000:2.0:1788917043.133745:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788917043.133752:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788917043.133757:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e36a34800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788917043.133760:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788917043.133774:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788917043.133782:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3303:1875815140771584:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788917043.148249:0:14247:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788917043.148480:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788917043.148487:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788917043.150134:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788917043.150299:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788917043.150696:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788917043.150703:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788917043.153699:0:14247:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788917043.153935:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788917043.153952:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788917043.155104:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788917043.155116:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788917043.191022:0:14247:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788917043.191844:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788917043.191851:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788917043.193810:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788917043.193827:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788917043.194770:0:14247:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788917043.195034:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788917043.195051:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788917043.195619:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788917043.195627:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788917043.196423:0:14247:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788917043.196588:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788917043.196594:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788917043.197430:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788917043.197439:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788917043.198094:0:14247:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788917043.198474:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788917043.198480:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788917043.199101:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788917043.199110:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788917043.221284:0:14247:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788917043.221442:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788917043.221449:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788917043.223600:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788917043.223617:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788917043.225628:0:14247:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788917043.225642:0:14247:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788917043.227060:0:14247:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788917043.227086:0:14247:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788917043.227092:0:14247:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788917043.227333:0:14247:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788917043.227366:0:14247:0:(tgt_mount.c:1493:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.140@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788917043.227369:0:14247:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788917043.227371:0:14247:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788917043.227372:0:14247:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788917043.227373:0:14247:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788917043.227374:0:14247:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788917043.227375:0:14247:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788917043.227376:0:14247:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788917043.227377:0:14247:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788917043.227378:0:14247:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788917043.227379:0:14247:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788917043.227380:0:14247:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788917043.227382:0:14247:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788917043.227382:0:14247:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788917043.227383:0:14247:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788917043.227384:0:14247:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788917043.227384:0:14247:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788917043.227385:0:14247:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788917043.227386:0:14247:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788917043.227386:0:14247:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788917043.227387:0:14247:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788917043.227387:0:14247:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788917043.227411:0:14247:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788917043.227427:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140771712:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788917043.227505:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917043.227558:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e04cb5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788917043.228060:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140771712 00000100:00100000:0.0:1788917043.228068:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140771712 00000100:00100000:0.0:1788917043.228119:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788917043.228128:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+5:14247:x1875815140771712:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788917043.228203:0:14259:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788917043.228207:0:14259:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788917043.228214:0:14259:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788917043.229083:0:14280:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788917043.229743:0:14259:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1788917043.230879:0:14281:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788917043.230884:0:14281:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788917043.230886:0:14281:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788917043.230907:0:14281:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788917043.231491:0:14259:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788917043.231503:0:14259:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788917043.239787:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+5:14247:x1875815140771712:12345-0@lo:253:mount.lustre.0 Request processed in 11647us (12267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917043.239803:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788917043.239814:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140771712:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788917043.239833:0:14247:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788917043.239837:0:14247:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788917043.239839:0:14247:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788917043.239840:0:14247:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788917043.239859:0:14247:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788917043.239861:0:14247:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788917043.239862:0:14247:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788917043.239864:0:14247:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788917043.239865:0:14247:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788917043.239868:0:14247:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788917043.239869:0:14247:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788917043.239896:0:14247:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a6e05362800 from lustre-MDT0000 10000000:01000000:3.0:1788917043.239932:0:14247:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788917043.239935:0:14247:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788917043.239941:0:14247:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a6e2cd0cd40 10000000:01000000:3.0:1788917043.239944:0:14247:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788917043.239952:0:14247:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a6e2cd0cd40 from 1 10000000:01000000:3.0:1788917043.239954:0:14247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788917043.240013:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83e6ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917043.240023:0:14247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83e6ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917043.240031:0:14247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83e6ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917043.240065:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140771840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788917043.240105:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917043.240142:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e04cb5240 going to sleep for 11 seconds 00000100:00100000:2.0:1788917043.240307:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140771840 00000100:00100000:2.0:1788917043.240314:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140771840 00000100:00100000:2.0:1788917043.240354:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788917043.240362:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+5:14247:x1875815140771840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788917043.240377:0:14258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917043.240394:0:14258:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e00030400/0x51de7f756a83e6f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83e6ef expref: -99 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.240425:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00030400/0x51de7f756a83e6f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83e6ef expref: 6 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.240437:0:14258:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e00030400/0x51de7f756a83e6f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e6ef expref: 6 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.240449:0:14258:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00030400, rc 0) 00000100:00100000:2.0:1788917043.240492:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+6:14247:x1875815140771840:12345-0@lo:101:mount.lustre.0 Request processed in 130us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917043.240510:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788917043.240592:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140771840:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788917043.240607:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83e6ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e6f6 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917043.240619:0:14247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83e6ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83e6f6 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917043.240749:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140771968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788917043.240780:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917043.240810:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140771968 00000100:00100000:2.0:1788917043.240814:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140771968 00000100:00100000:2.0:1788917043.240866:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788917043.240871:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+6:14247:x1875815140771968:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788917043.240882:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e113cd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788917043.241228:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+6:14247:x1875815140771968:12345-0@lo:501:mount.lustre.0 Request processed in 356us (447us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788917043.241236:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788917043.241339:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140771968:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788917043.241366:0:14247:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788917043.241460:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83e6ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e6f6 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917043.241470:0:14247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83e6ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e6f6 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788917043.241479:0:14247:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a6e05362800 10000000:01000000:0.0:1788917043.241484:0:14247:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788917043.241488:0:14247:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a6e05362800 10000000:01000000:0.0:1788917043.241497:0:14247:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788917043.241500:0:14247:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9a6e05362800 from 1 10000000:01000000:0.0:1788917043.241503:0:14247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788917043.241664:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83e6fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917043.241673:0:14247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83e6fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917043.241682:0:14247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83e6fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917043.241697:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140772096:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788917043.241728:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917043.241757:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e113cd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788917043.241766:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140772096 00000100:00100000:3.0:1788917043.241771:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140772096 00000100:00100000:3.0:1788917043.241801:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788917043.241806:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+6:14247:x1875815140772096:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788917043.241813:0:14257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917043.241825:0:14257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e2d18fe00/0x51de7f756a83e704 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83e6fd expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917043.241844:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e2d18fe00/0x51de7f756a83e704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83e6fd expref: 7 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917043.241851:0:14257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e2d18fe00/0x51de7f756a83e704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e6fd expref: 7 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917043.241857:0:14257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18fe00, rc 0) 00000100:00100000:3.0:1788917043.241885:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+7:14247:x1875815140772096:12345-0@lo:101:mount.lustre.0 Request processed in 79us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917043.241889:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788917043.241967:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140772096:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788917043.241978:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83e6fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e704 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917043.241987:0:14247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83e6fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83e704 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788917043.241998:0:14247:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788917043.242213:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83e6fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e704 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917043.242223:0:14247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3000/0x51de7f756a83e6fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e704 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788917043.242230:0:14247:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788917043.242240:0:14247:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788917043.242245:0:14247:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a6e05362800 10000000:01000000:0.0:1788917043.242248:0:14247:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788917043.242251:0:14247:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788917043.242254:0:14247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788917043.242269:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3a00/0x51de7f756a83e70b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917043.242276:0:14247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3a00/0x51de7f756a83e70b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917043.242282:0:14247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3a00/0x51de7f756a83e70b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917043.242293:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140772224:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788917043.242319:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917043.242341:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e113cd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788917043.242350:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140772224 00000100:00100000:2.0:1788917043.242355:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140772224 00000100:00100000:2.0:1788917043.242384:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788917043.242389:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+7:14247:x1875815140772224:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788917043.242396:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917043.242405:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e00030600/0x51de7f756a83e712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83e70b expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.242419:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00030600/0x51de7f756a83e712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83e70b expref: 8 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.242427:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e00030600/0x51de7f756a83e712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e70b expref: 8 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.242433:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00030600, rc 0) 00000100:00100000:2.0:1788917043.242465:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+8:14247:x1875815140772224:12345-0@lo:101:mount.lustre.0 Request processed in 76us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917043.242470:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788917043.244344:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140772224:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788917043.244374:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3a00/0x51de7f756a83e70b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e712 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917043.244386:0:14247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3a00/0x51de7f756a83e70b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83e712 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917043.244468:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140772352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788917043.244543:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917043.244588:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e113cd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788917043.244600:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140772352 00000100:00100000:2.0:1788917043.244622:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140772352 00000100:00100000:2.0:1788917043.244677:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788917043.244686:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+8:14247:x1875815140772352:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788917043.245259:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+9:14247:x1875815140772352:12345-0@lo:501:mount.lustre.0 Request processed in 572us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917043.245268:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788917043.245392:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140772352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788917043.245438:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140772480:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788917043.245482:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917043.245560:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e113cd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788917043.245595:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140772480 00000100:00100000:3.0:1788917043.245599:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140772480 00000100:00100000:3.0:1788917043.245648:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788917043.245654:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+9:14247:x1875815140772480:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788917043.245982:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+9:14247:x1875815140772480:12345-0@lo:503:mount.lustre.0 Request processed in 327us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917043.245989:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788917043.246087:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140772480:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788917043.246801:0:14282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14282:1875815140772608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788917043.247375:0:14282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917043.247419:0:14282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3c5f9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788917043.247521:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140772608 00000100:00100000:2.0:1788917043.247529:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140772608 00000100:00100000:2.0:1788917043.247557:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788917043.247563:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+9:14282:x1875815140772608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788917043.247852:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+9:14282:x1875815140772608:12345-0@lo:502:llog_process_th.0 Request processed in 288us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917043.247860:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788917043.249229:0:14282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14282:1875815140772608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788917043.249301:0:14282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788917043.249328:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788917043.249332:0:14282:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788917043.249346:0:14282:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788917043.249351:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788917043.249385:0:14282:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a6e0a77b380) 00000020:00000080:1.0:1788917043.249421:0:14282:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788917043.249429:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788917043.249539:0:14282:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788917043.249552:0:14282:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x51de7f756a83e720 00000020:00000080:1.0:1788917043.249828:0:14282:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788917043.249832:0:14282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788917043.249835:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788917043.249837:0:14282:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788917043.249840:0:14282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788917043.249843:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788917043.249845:0:14282:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788917043.249848:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788917043.249855:0:14282:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a6e0a7799c0) 00000020:00000080:1.0:1788917043.249865:0:14282:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788917043.249869:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788917043.249871:0:14282:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788917043.249875:0:14282:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788917043.249881:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788917043.249926:0:14282:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6e05362800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788917043.249939:0:14282:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a6e0a77cd40) 00000020:00000080:1.0:1788917043.249947:0:14282:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788917043.250015:0:14282:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788917043.250022:0:14282:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x51de7f756a83e735 00000020:00000080:1.0:1788917043.250131:0:14282:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788917043.250138:0:14282:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788917043.250143:0:14282:0:(genops.c:1407:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x51de7f756a83e73c 00080000:01000000:1.0:1788917043.250318:0:14282:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788917043.250323:0:14282:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x51de7f756a83e743 00010000:00010000:1.0:1788917043.304874:0:14282:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788917043.305598:0:14282:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1788917043.305870:0:14282:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788917043.306561:0:14282:0:(genops.c:414:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a6e1fe919c0) 00000020:00000080:0.0:1788917043.306581:0:14282:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788917043.307528:0:14282:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788917043.307538:0:14282:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x51de7f756a83e751 00000020:00000080:0.0:1788917043.312053:0:14282:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788917043.317812:0:14282:0:(genops.c:1407:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x51de7f756a83e758 00000020:00000080:0.0:1788917043.320871:0:14282:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788917043.320894:0:14282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788917043.320910:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.320913:0:14282:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788917043.320918:0:14282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788917043.320922:0:14282:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788917043.320923:0:14282:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788917043.320924:0:14282:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788917043.320926:0:14282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788917043.320928:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.320930:0:14282:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788917043.320933:0:14282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788917043.320938:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.320939:0:14282:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788917043.320945:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788917043.321004:0:14282:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788917043.321022:0:14282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788917043.321026:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.321027:0:14282:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788917043.321030:0:14282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788917043.321063:0:14282:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788917043.321068:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.321069:0:14282:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788917043.321074:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788917043.321080:0:14282:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:0.0:1788917043.321117:0:14282:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788917043.321120:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788917043.321142:0:14282:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a6e1fe94d40) 00000020:00000080:0.0:1788917043.321187:0:14282:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788917043.321194:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788917043.321281:0:14282:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788917043.321291:0:14282:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788917043.321301:0:14282:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x51de7f756a83e766 00010000:00080000:0.0:1788917043.321351:0:14282:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6e111ab800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1788917043.321892:0:14282:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788917043.323009:0:14282:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788917043.323832:0:14282:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788917043.326823:0:14282:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788917043.326914:0:14282:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788917043.327007:0:14282:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788917043.327874:0:14286:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917043.327881:0:14286:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788917043.328787:0:14282:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788917043.328801:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788917043.328839:0:14282:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788917043.328861:0:14282:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x51de7f756a83e76d 00000100:00080000:0.0:1788917043.328874:0:14282:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788917043.328881:0:14282:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a6e111ab800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1788917043.328924:0:14282:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e3fcbad80 x1875815140772736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788917043.329003:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140772736:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788917043.329089:0:3303:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875815140772736 offset 0 length 520: 4 00000100:00080000:0.0:1788917043.330578:0:14282:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788917043.330751:0:14282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788917043.330773:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.330776:0:14282:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788917043.330780:0:14282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788917043.330783:0:14282:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1788917043.330784:0:14282:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788917043.330785:0:14282:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788917043.330787:0:14282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788917043.330789:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.330791:0:14282:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788917043.330794:0:14282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788917043.330799:0:14282:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788917043.330802:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.330804:0:14282:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788917043.330807:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788917043.330812:0:14282:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:0.0:1788917043.330844:0:14282:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788917043.330847:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788917043.330868:0:14282:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a6e1fe90000) 00000020:00000080:0.0:1788917043.330890:0:14282:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788917043.330895:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788917043.330966:0:14282:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788917043.330971:0:14282:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788917043.330983:0:14282:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x51de7f756a83e77b 00010000:00080000:0.0:1788917043.331028:0:14282:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6e06d91000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1788917043.331272:0:14282:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788917043.331451:0:14282:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788917043.331470:0:14282:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788917043.332941:0:14282:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 0, last_idx 1 00000040:00080000:0.0:1788917043.334324:0:14282:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788917043.334398:0:14282:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788917043.334476:0:14282:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788917043.336598:0:14288:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:0.0:1788917043.336605:0:14288:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788917043.338819:0:14282:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788917043.338836:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788917043.338881:0:14282:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788917043.338906:0:14282:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x51de7f756a83e782 00000100:00080000:0.0:1788917043.338918:0:14282:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788917043.338926:0:14282:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a6e06d91000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1788917043.338970:0:14282:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e3fcb8e00 x1875815140772864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788917043.339015:0:14282:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788917043.339181:0:14282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788917043.339187:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.339189:0:14282:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788917043.339193:0:14282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788917043.339197:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.339198:0:14282:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788917043.339202:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788917043.339204:0:14282:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788917043.339206:0:14282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788917043.339209:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.339211:0:14282:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788917043.339213:0:14282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788917043.339216:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.339217:0:14282:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788917043.339220:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788917043.339262:0:14282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14282:1875815140772992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788917043.339366:0:14282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917043.339396:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140772992 00000100:00100000:3.0:1788917043.339405:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140772992 00000100:00100000:0.0:1788917043.339411:0:14282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cda9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788917043.339566:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788917043.339578:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+9:14282:x1875815140772992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788917043.339973:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+9:14282:x1875815140772992:12345-0@lo:502:llog_process_th.0 Request processed in 396us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917043.339982:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788917043.340034:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140772864:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788917043.340082:0:3303:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875815140772864 offset 0 length 520: 4 00000100:00100000:0.0:1788917043.340486:0:14282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14282:1875815140772992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788917043.340518:0:14282:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788917043.340523:0:14282:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.340530:0:14282:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788917043.340537:0:14282:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788917043.340710:0:14247:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788917043.340734:0:14247:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788917043.340756:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3a00/0x51de7f756a83e70b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e712 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917043.340770:0:14247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3a00/0x51de7f756a83e70b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e712 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788917043.340782:0:14247:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a6e05362800 from 1 10000000:01000000:0.0:1788917043.340786:0:14247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788917043.340827:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917043.340837:0:14247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917043.340849:0:14247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917043.340865:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140773120:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788917043.340903:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917043.340948:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cda9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788917043.341025:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140773120 00000100:00100000:2.0:1788917043.341032:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140773120 00000100:00100000:2.0:1788917043.341085:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788917043.341094:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+9:14247:x1875815140773120:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788917043.341106:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917043.341126:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e790 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83e789 expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.341174:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83e789 expref: 10 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.341187:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e789 expref: 10 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.341205:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00030a00, rc 0) 00000100:00100000:2.0:1788917043.341295:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+10:14247:x1875815140773120:12345-0@lo:101:mount.lustre.0 Request processed in 201us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917043.341301:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788917043.341409:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140773120:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788917043.341425:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e789 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e790 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917043.341447:0:14247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e789 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83e790 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917043.342047:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140773248:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788917043.342093:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917043.342202:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3c5f90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788917043.342297:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140773248 00000100:00100000:3.0:1788917043.342302:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140773248 00000100:00100000:3.0:1788917043.342377:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788917043.342386:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+10:14247:x1875815140773248:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788917043.342402:0:14258:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788917043.342410:0:14258:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788917043.342834:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+10:14247:x1875815140773248:12345-0@lo:256:mount.lustre.0 Request processed in 448us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917043.342841:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788917043.342901:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140773248:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788917043.343515:0:14247:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788917043.343590:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e790 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917043.343602:0:14247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e790 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788917043.343611:0:14247:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e05362800 from 1 10000000:01000000:1.0:1788917043.343614:0:14247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788917043.343705:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabe00/0x51de7f756a83e797 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917043.343713:0:14247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabe00/0x51de7f756a83e797 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917043.343723:0:14247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabe00/0x51de7f756a83e797 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917043.343740:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140773376:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788917043.343776:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917043.343821:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3c5f90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788917043.343928:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140773376 00000100:00100000:0.0:1788917043.343936:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140773376 00000100:00100000:0.0:1788917043.343981:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788917043.343989:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+10:14247:x1875815140773376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788917043.344002:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917043.344021:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83e79e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83e797 expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917043.344069:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83e79e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83e797 expref: 11 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917043.344081:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83e79e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e797 expref: 11 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917043.344090:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2200, rc 0) 00000100:00100000:0.0:1788917043.344171:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+11:14247:x1875815140773376:12345-0@lo:101:mount.lustre.0 Request processed in 145us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917043.344179:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140773376:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788917043.344181:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788917043.344200:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabe00/0x51de7f756a83e797 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e79e expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917043.344210:0:14247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabe00/0x51de7f756a83e797 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83e79e expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917043.344262:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140773504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788917043.344291:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917043.344366:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3c5f90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788917043.344467:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140773504 00000100:00100000:3.0:1788917043.344472:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140773504 00000100:00100000:3.0:1788917043.344540:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788917043.344549:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+11:14247:x1875815140773504:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788917043.345331:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+11:14247:x1875815140773504:12345-0@lo:501:mount.lustre.0 Request processed in 782us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917043.345340:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788917043.345438:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140773504:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788917043.345484:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140773632:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788917043.345527:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917043.345556:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cda600 going to sleep for 11 seconds 00000100:00100000:2.0:1788917043.345569:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140773632 00000100:00100000:2.0:1788917043.345575:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140773632 00000100:00100000:2.0:1788917043.345647:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788917043.345655:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+11:14247:x1875815140773632:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788917043.345813:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+11:14247:x1875815140773632:12345-0@lo:503:mount.lustre.0 Request processed in 159us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917043.345821:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788917043.345842:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140773632:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788917043.346731:0:14290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14290:1875815140773760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788917043.346779:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917043.346806:0:14290:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cdaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788917043.346829:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140773760 00000100:00100000:3.0:1788917043.346835:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140773760 00000100:00100000:3.0:1788917043.346873:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788917043.346882:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+11:14290:x1875815140773760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788917043.347227:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+11:14290:x1875815140773760:12345-0@lo:502:llog_process_th.0 Request processed in 346us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917043.347235:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788917043.347366:0:14290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14290:1875815140773760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788917043.347393:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788917043.347405:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.347408:0:14290:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788917043.347418:0:14290:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6e05362800 00000020:00000080:0.0:1788917043.347421:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788917043.347430:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788917043.347440:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.347441:0:14290:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788917043.347445:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788917043.347448:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.347449:0:14290:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788917043.347453:0:14290:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6e05362800 00000020:00000080:0.0:1788917043.347455:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788917043.347522:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788917043.347526:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.347528:0:14290:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788917043.347532:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788917043.347535:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.347537:0:14290:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788917043.347541:0:14290:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a6e05362800 00000020:00000080:0.0:1788917043.347543:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788917043.347581:0:14290:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14290:1875815140773888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788917043.347630:0:14290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917043.347666:0:14290:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cdaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788917043.351237:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140773888 00000100:00100000:2.0:1788917043.351256:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140773888 00000100:00100000:2.0:1788917043.351329:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788917043.351342:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+11:14290:x1875815140773888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788917043.351723:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+11:14290:x1875815140773888:12345-0@lo:502:llog_process_th.0 Request processed in 384us (4091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917043.351732:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788917043.351750:0:14290:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14290:1875815140773888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788917043.351795:0:14290:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788917043.351806:0:14290:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917043.351809:0:14290:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788917043.351817:0:14290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788917043.351976:0:14247:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788917043.351999:0:14247:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788917043.352023:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabe00/0x51de7f756a83e797 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e79e expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.352045:0:14247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabe00/0x51de7f756a83e797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e79e expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788917043.352115:0:14247:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788917043.352118:0:14247:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a6e05362800 10000000:01000000:2.0:1788917043.352122:0:14247:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a6e05362800 10000000:01000000:2.0:1788917043.352127:0:14247:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788917043.352135:0:14247:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a6e05362800 from 1 10000000:01000000:2.0:1788917043.352138:0:14247:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788917043.352200:0:14247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83e7a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.352209:0:14247:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83e7a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.352220:0:14247:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83e7a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917043.352243:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140774016:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788917043.352305:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917043.352341:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e37e38480 going to sleep for 11 seconds 00000100:00100000:0.0:1788917043.353726:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140774016 00000100:00100000:0.0:1788917043.353739:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140774016 00000100:00100000:0.0:1788917043.356259:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788917043.356280:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+11:14247:x1875815140774016:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788917043.356303:0:14258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917043.356326:0:14258:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee2600/0x51de7f756a83e7ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83e7a5 expref: -99 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917043.356376:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee2600/0x51de7f756a83e7ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83e7a5 expref: 12 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917043.356387:0:14258:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee2600/0x51de7f756a83e7ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e7a5 expref: 12 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917043.356396:0:14258:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2600, rc 0) 00000100:00100000:0.0:1788917043.356488:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14247:x1875815140774016:12345-0@lo:101:mount.lustre.0 Request processed in 215us (4183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917043.356495:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788917043.357825:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140774016:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788917043.357858:0:14247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83e7a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e7ac expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.357871:0:14247:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83e7a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83e7ac expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917043.357969:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140774144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788917043.358026:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917043.358088:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e37e38480 going to sleep for 11 seconds 00000100:00100000:2.0:1788917043.358109:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140774144 00000100:00100000:2.0:1788917043.358116:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140774144 00000100:00100000:2.0:1788917043.358175:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788917043.358185:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14247:x1875815140774144:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788917043.358487:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14247:x1875815140774144:12345-0@lo:501:mount.lustre.0 Request processed in 302us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917043.358494:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788917043.358532:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140774144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788917043.358563:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140774272:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788917043.358600:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917043.358614:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e37e38480 going to sleep for 11 seconds 00000100:00100000:2.0:1788917043.358627:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140774272 00000100:00100000:2.0:1788917043.358631:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140774272 00000100:00100000:2.0:1788917043.359739:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788917043.359745:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14247:x1875815140774272:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788917043.359921:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14247:x1875815140774272:12345-0@lo:503:mount.lustre.0 Request processed in 175us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917043.359926:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788917043.359972:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140774272:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788917043.362868:0:14294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14294:1875815140774400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788917043.362954:0:14294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917043.362998:0:14294:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cda000 going to sleep for 11 seconds 00000100:00100000:2.0:1788917043.363062:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140774400 00000100:00100000:2.0:1788917043.363069:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140774400 00000100:00100000:2.0:1788917043.363108:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788917043.363117:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14294:x1875815140774400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788917043.363500:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14294:x1875815140774400:12345-0@lo:502:llog_process_th.0 Request processed in 383us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917043.363513:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788917043.364010:0:14294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14294:1875815140774400:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788917043.364087:0:14294:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788917043.364105:0:14294:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a6e1fe93380) 00000020:00000080:0.0:1788917043.364127:0:14294:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788917043.364338:0:14294:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6e05362800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788917043.364342:0:14294:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6e05362800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788917043.364344:0:14294:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6e05362800 4 00010000:00080000:0.0:1788917043.364375:0:14294:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6e171d4800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1788917043.372438:0:14294:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788917043.372585:0:14294:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788917043.372630:0:14294:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788917043.372646:0:14294:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x51de7f756a83e7ba 00000100:00080000:0.0:1788917043.372659:0:14294:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788917043.372668:0:14294:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a6e171d4800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1788917043.372724:0:14294:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e3fcba680 x1875815140774528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788917043.372756:0:14294:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788917043.374267:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875815140774528:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788917043.374373:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917043.374438:0:14294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14294:1875815140774656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788917043.374493:0:14294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917043.374543:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140774656 00000100:00100000:2.0:1788917043.374552:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140774656 00000100:00100000:2.0:1788917043.374620:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788917043.374630:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14294:x1875815140774656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788917043.374867:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140774528 00000100:00100000:3.0:1788917043.374873:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140774528 00000100:00100000:2.0:1788917043.374937:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14294:x1875815140774656:12345-0@lo:502:llog_process_th.0 Request processed in 307us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917043.374942:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788917043.374951:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875815140774528:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788917043.374955:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788917043.375001:0:14294:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e173da600 going to sleep for 11 seconds 00000100:00100000:3.0:1788917043.375023:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875815140774528:12345-0@lo:38:llog_process_th.0 Request processed in 70us (649us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788917043.375029:0:14294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14294:1875815140774656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788917043.375047:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:2.0:1788917043.375089:0:14294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788917043.375190:0:14247:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788917043.375215:0:14247:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:3.0:1788917043.375242:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00010000:00010000:2.0:1788917043.375242:0:14247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83e7a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e7ac expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788917043.375252:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e171d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788917043.375258:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00010000:00010000:2.0:1788917043.375258:0:14247:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e00030000/0x51de7f756a83e7a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e7ac expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917043.375265:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875815140774528:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1788917043.375321:0:14247:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788917043.375323:0:14247:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788917043.375325:0:14247:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788917043.375327:0:14247:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788917043.375329:0:14247:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788917043.375330:0:14247:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788917043.375331:0:14247:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788917043.375338:0:14247:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788917043.375340:0:14247:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788917043.375341:0:14247:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788917043.375346:0:14247:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788917043.375348:0:14247:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788917043.375350:0:14247:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788917043.375350:0:14247:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788917043.375351:0:14247:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788917043.375352:0:14247:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788917043.375353:0:14247:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788917043.375354:0:14247:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788917043.375355:0:14247:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788917043.375356:0:14247:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788917043.375357:0:14247:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788917043.375371:0:14247:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788917043.375383:0:14247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140774784:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788917043.375424:0:14247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917043.375455:0:14247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e173da600 going to sleep for 11 seconds 00000100:00100000:3.0:1788917043.375469:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140774784 00000100:00100000:3.0:1788917043.375475:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140774784 00000100:00100000:3.0:1788917043.375545:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788917043.375554:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14247:x1875815140774784:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788917043.375601:0:14259:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788917043.375618:0:14259:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788917043.407910:0:14259:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788917043.407939:0:14259:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788917043.407998:0:14280:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788917043.408004:0:14280:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788917043.408032:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e7c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.408067:0:14280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e790 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e789 expref: 12 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.408077:0:14280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e7c1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.408129:0:14280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83e789 expref: 12 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.408174:0:14280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e790 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83e789 expref: 12 pid: 14259 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917043.408214:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14280:1875815140774912:0@lo:104: 00000100:00100000:2.0:1788917043.408296:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917043.408342:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e173dad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788917043.408574:0:14248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140774912 00000100:00100000:3.0:1788917043.408583:0:14248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140774912 00000100:00100000:3.0:1788917043.408630:0:14248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788917043.408648:0:14248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+3:14280:x1875815140774912:12345-0@lo:104: 00010000:00010000:3.0:1788917043.408665:0:14248:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83e790 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917043.408744:0:14248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788917043.408755:0:14248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+3:14280:x1875815140774912:12345-0@lo:104: Request processed in 109us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917043.408763:0:14248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788917043.408786:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917043.408792:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83e790 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917043.408799:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2c00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1788917043.408803:0:14254:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83e790 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917043.408812:0:14254:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83e790 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788917043.408819:0:14254:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e789 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83e790 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788917043.408826:0:14254:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788917043.408859:0:14254:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e789 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e790 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917043.408864:0:14254:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788917043.408885:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e789 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e790 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917043.408891:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e789 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e790 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917043.408908:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917043.408909:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917043.408911:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917043.408948:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3305:1875815140775040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788917043.408977:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917043.409181:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14280:1875815140774912:0@lo:104: 00010000:00010000:2.0:1788917043.409206:0:14280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e7c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917043.409855:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140775040 00000100:00100000:1.0:1788917043.409861:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140775040 00010000:00010000:1.0:1788917043.409886:0:14251:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e790 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83e789 expref: 13 pid: 14259 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917043.409909:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788917043.409916:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37137100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+13:3305:x1875815140775040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788917043.409929:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788917043.409934:0:14251:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e790 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83e789 expref: 13 pid: 14259 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917043.409945:0:14251:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83e789 expref: 13 pid: 14259 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917043.409960:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e790 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83e789 expref: 13 pid: 14259 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917043.409979:0:14251:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e7c1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917043.409996:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e7c1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788917043.410011:0:14251:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002008517s 00010000:00010000:1.0:1788917043.410015:0:14251:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e7c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917043.410022:0:14251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e7c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917043.410028:0:14251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e7c1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917043.410047:0:14251:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e7c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917043.410054:0:14251:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788917043.410058:0:14251:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e7c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917043.410066:0:14251:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e7c1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917043.410079:0:14251:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e7c1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917043.410089:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788917043.410136:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37137100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:3305:x1875815140775040:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917043.410159:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788917043.410215:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3305:1875815140775040:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788917043.410298:0:14280:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e7c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.410306:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e7c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917043.410311:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e7c1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917043.418868:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+11:14247:x1875815140774784:12345-0@lo:253:mount.lustre.0 Request processed in 43303us (43431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917043.418886:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788917043.419047:0:14247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14247:1875815140774784:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788917043.419069:0:14247:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788917043.419073:0:14247:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788917043.419075:0:14247:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788917043.419077:0:14247:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788917043.419078:0:14247:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788917043.419079:0:14247:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788917043.419081:0:14247:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788917043.419082:0:14247:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788917043.419084:0:14247:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788917043.419086:0:14247:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788917043.419088:0:14247:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788917043.419119:0:14247:0:(tgt_mount.c:2781:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788917043.423215:0:14247:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788917043.423395:0:14247:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788917043.423670:0:14247:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788917043.423816:0:14247:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788917043.424083:0:14247:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788917043.424279:0:14247:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788917043.428470:0:14247:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788917043.428661:0:14247:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788917043.429063:0:14247:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788917043.429283:0:14247:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788917043.429588:0:14247:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788917043.429735:0:14247:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788917043.457372:0:14247:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788917043.457829:0:14247:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788917043.457842:0:14303:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788917043.457848:0:14303:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1788917043.458115:0:14304:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788917043.458229:0:14304:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788917043.460810:0:14304:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788917043.460912:0:14304:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788917043.460917:0:14304:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788917043.462935:0:14247:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788917043.463229:0:14247:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788917043.464018:0:14247:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788917043.464030:0:14247:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788917043.464483:0:14247:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788917043.465775:0:14247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788917043.466560:0:14247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788917043.466602:0:14247:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788917043.467457:0:14247:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1788917043.468753:0:14247:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788917043.474867:0:14247:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788917043.497757:0:14247:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788917043.497804:0:14247:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb14041097988 00100000:10000000:3.0:1788917043.497813:0:14247:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788917043.498360:0:14247:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788917043.498559:0:14247:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788917043.498579:0:14247:0:(tgt_mount.c:2550:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788917043.498607:0:14247:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788917044.127297:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788917044.323341:0:14262:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788917044.323353:0:14262:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a6e05362800 from 6 10000000:01000000:0.0:1788917044.323359:0:14262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788917044.323444:0:14262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3600/0x51de7f756a83e7c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917044.323921:0:14262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3600/0x51de7f756a83e7c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917044.323939:0:14262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3600/0x51de7f756a83e7c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917044.323976:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcbb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140775168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788917044.324089:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917044.324233:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06fedc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788917044.326285:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140775168 00000100:00100000:2.0:1788917044.326302:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140775168 00000100:00100000:2.0:1788917044.326403:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788917044.326416:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+11:14262:x1875815140775168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788917044.326438:0:14258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917044.326466:0:14258:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e00031600/0x51de7f756a83e7cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83e7c8 expref: -99 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917044.326500:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00031600/0x51de7f756a83e7cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83e7c8 expref: 12 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917044.326512:0:14258:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e00031600/0x51de7f756a83e7cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e7c8 expref: 12 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917044.326523:0:14258:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031600, rc 0) 00000100:00100000:2.0:1788917044.326617:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14262:x1875815140775168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (2527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917044.326623:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788917044.326648:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcbb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140775168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788917044.326670:0:14262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3600/0x51de7f756a83e7c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e7cf expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917044.326680:0:14262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3600/0x51de7f756a83e7c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83e7cf expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917044.326766:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcbb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140775296:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788917044.326808:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917044.328688:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140775296 00000100:00100000:3.0:1788917044.328706:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140775296 00000100:00100000:0.0:1788917044.328741:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06fedc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788917044.328785:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788917044.328797:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14262:x1875815140775296:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788917044.328827:0:14259:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788917044.328852:0:14259:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788917044.328855:0:14259:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788917044.328999:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14262:x1875815140775296:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 204us (2189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917044.329008:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788917044.329298:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcbb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140775296:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788917044.329375:0:14262:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788917044.329387:0:14262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3600/0x51de7f756a83e7c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e7cf expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917044.329412:0:14262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3600/0x51de7f756a83e7c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e7cf expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788917044.383422:0:14298:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788917044.383435:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917044.383878:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788917044.383885:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788917045.152270:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917045.407486:0:14298:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788917045.407499:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917045.407538:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788917045.407545:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788917046.175392:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788917046.346960:0:14547:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788917047.199318:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788917047.925705:0:14698:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb33983c0 20000000:00000080:1.0:1788917047.925721:0:14698:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6e3beea800 uarg=0000000000000000 20000000:01000000:1.0:1788917047.925754:0:14698:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788917047.925761:0:14698:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788917047.925766:0:14698:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788917047.926476:0:14699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788917047.926557:0:14698:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788917047.941838:0:14698:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788917047.941873:0:14698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83e7d6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917047.941893:0:14698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83e79e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e797 expref: 11 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917047.941902:0:14698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83e7d6 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917047.941948:0:14698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83e79e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83e797 expref: 11 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917047.941964:0:14698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83e79e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83e797 expref: 11 pid: 14259 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917047.941981:0:14698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a682300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14698:1875815140775424:0@lo:104: 00000100:00100000:1.0:1788917047.942069:0:14698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917047.942132:0:14698:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e408fecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788917047.942198:0:14248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140775424 00000100:00100000:3.0:1788917047.942207:0:14248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140775424 00000100:00100000:3.0:1788917047.942253:0:14248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788917047.942261:0:14248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a681180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+3:14698:x1875815140775424:12345-0@lo:104: 00010000:00010000:3.0:1788917047.942272:0:14248:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabe00/0x51de7f756a83e797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83e79e expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917047.942322:0:14248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788917047.942326:0:14248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a681180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+3:14698:x1875815140775424:12345-0@lo:104: Request processed in 67us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917047.942331:0:14248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788917047.942347:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917047.942352:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabe00/0x51de7f756a83e797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83e79e expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917047.942358:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeabe00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1788917047.942361:0:14253:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabe00/0x51de7f756a83e797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83e79e expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917047.942368:0:14253:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabe00/0x51de7f756a83e797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83e79e expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788917047.942372:0:14253:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabe00/0x51de7f756a83e797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83e79e expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788917047.942375:0:14253:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788917047.942402:0:14253:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabe00/0x51de7f756a83e797 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e79e expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917047.942420:0:14253:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788917047.942511:0:14698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a682300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14698:1875815140775424:0@lo:104: 00010000:00010000:0.0:1788917047.942527:0:14698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83e7d6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917047.943263:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabe00/0x51de7f756a83e797 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e79e expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917047.943273:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabe00/0x51de7f756a83e797 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e79e expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917047.943290:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917047.943292:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917047.943294:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917047.943329:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140775552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788917047.943372:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917047.943460:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140775552 00000100:00100000:1.0:1788917047.943466:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140775552 00010000:00010000:1.0:1788917047.943491:0:14250:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83e79e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83e797 expref: 12 pid: 14259 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917047.943536:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788917047.943543:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:3306:x1875815140775552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788917047.943555:0:14250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788917047.943561:0:14250:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83e79e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83e797 expref: 12 pid: 14259 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917047.943571:0:14250:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83e79e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83e797 expref: 12 pid: 14259 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917047.943586:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83e79e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83e797 expref: 12 pid: 14259 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917047.943663:0:14250:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83e7d6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917047.943671:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83e7d6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917047.943685:0:14250:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83e7d6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917047.943693:0:14250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83e7d6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917047.943701:0:14250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83e7d6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917047.943708:0:14250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83e7d6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917047.943723:0:14250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab600 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788917047.943727:0:14250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83e7d6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917047.943734:0:14250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83e7d6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917047.943750:0:14250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83e7d6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917047.943759:0:14250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788917047.943801:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+11:3306:x1875815140775552:12345-0@lo:103:ldlm_bl.0 Request processed in 258us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917047.943808:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788917047.943849:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140775552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788917047.945914:0:14698:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83e7d6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917047.945933:0:14698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83e7d6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917047.945941:0:14698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e1eeab600/0x51de7f756a83e7d6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917048.225579:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788917048.864342:0:13862:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788917048.864351:0:13862:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788917048.864355:0:13862:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788917048.864358:0:13862:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788917048.864361:0:13862:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788917048.864364:0:13862:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788917048.864370:0:13862:0:(import.c:65:import_set_state_nolock()) ffff9a6e171d4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788917048.864387:0:13862:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a6e171d4800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1788917048.864418:0:13862:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e3a682d80 x1875815140775808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788917048.864479:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875815140775808:0@lo:38:kworker.0 00000100:00100000:3.0:1788917048.864504:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140775680:0@lo:400:kworker.0 00000100:00100000:3.0:1788917048.864578:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917048.864578:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917048.864747:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140775808 00000100:00100000:0.0:1788917048.864757:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140775808 00000100:00100000:0.0:1788917048.864808:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788917048.864816:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875815140775808:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788917048.864845:0:14266:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:0.0:1788917048.864895:0:14266:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x51de7f756a83e7dd 00000004:00100000:0.0:1788917048.864924:0:14266:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788917048.865075:0:14266:0:(import.c:65:import_set_state_nolock()) ffff9a6e171d0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788917048.865132:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875815140775808:12345-0@lo:38:kworker.0 Request processed in 315us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917048.865139:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788917048.865395:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a6e3a682d80 x1875815140775808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788917058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788917048.865416:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788917048.865425:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788917048.865442:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788917048.865446:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e171d4800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788917048.865454:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875815140775808:0@lo:38:kworker.0 00000100:00100000:1.0:1788917048.866282:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140775680 00000100:00100000:1.0:1788917048.866300:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140775680 00000100:00100000:1.0:1788917048.866354:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788917048.866363:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+11:3307:x1875815140775680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917048.866792:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+11:3307:x1875815140775680:12345-0@lo:400:kworker.0 Request processed in 430us (2219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917048.866799:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788917048.866898:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140775680:0@lo:400:kworker.0 00010000:00010000:3.0:1788917049.247810:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788917049.887874:0:14262:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788917049.887888:0:14262:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e05362800 from 10 10000000:01000000:1.0:1788917049.887895:0:14262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788917049.887963:0:14262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83e7e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917049.887992:0:14262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83e7e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917049.888007:0:14262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83e7e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917049.888044:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140775936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788917049.888178:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917049.888231:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140775936 00000100:00100000:1.0:1788917049.888236:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e03254000 going to sleep for 11 seconds 00000100:00100000:0.0:1788917049.888244:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140775936 00000100:00100000:0.0:1788917049.888315:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788917049.888328:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+11:14262:x1875815140775936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788917049.888346:0:14257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917049.888364:0:14257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee3200/0x51de7f756a83e7eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83e7e4 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917049.888394:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee3200/0x51de7f756a83e7eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83e7e4 expref: 12 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917049.888406:0:14257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee3200/0x51de7f756a83e7eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e7e4 expref: 12 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917049.888417:0:14257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3200, rc 0) 00000100:00100000:0.0:1788917049.888468:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14262:x1875815140775936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917049.888476:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788917049.890706:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140775936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788917049.890923:0:14262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83e7e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e7eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917049.890938:0:14262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83e7e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83e7eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917049.891044:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140776064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788917049.891140:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917049.891376:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e03254000 going to sleep for 11 seconds 00000100:00100000:2.0:1788917049.891656:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140776064 00000100:00100000:2.0:1788917049.891665:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140776064 00000100:00100000:2.0:1788917049.891803:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788917049.891814:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14262:x1875815140776064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788917049.892138:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14262:x1875815140776064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 325us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917049.892169:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788917049.892251:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140776064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788917049.892291:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140776192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788917049.892328:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917049.892860:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e03254000 going to sleep for 11 seconds 00000100:00100000:0.0:1788917049.892927:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140776192 00000100:00100000:0.0:1788917049.892933:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140776192 00000100:00100000:0.0:1788917049.892961:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788917049.892968:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14262:x1875815140776192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788917049.893321:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14262:x1875815140776192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 352us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917049.893335:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788917049.895300:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140776192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788917049.896996:0:14829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788917049.897470:0:14262:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788917049.897494:0:14262:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788917049.897508:0:14262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83e7e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e7eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917049.897521:0:14262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83e7e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e7eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917050.271420:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788917050.706062:0:14899:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788917050.706066:0:14899:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788917050.706244:0:14899:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a6e3fe0e800 00000020:01000004:2.0:1788917050.706260:0:14899:0:(tgt_mount.c:2592:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788917050.706272:0:14899:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788917050.706286:0:14899:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a6e0b5c99c0) 00000020:00000080:2.0:1788917050.706303:0:14899:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788917050.742744:0:14899:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788917050.743139:0:14899:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788917050.744411:0:14899:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788917050.744769:0:14899:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788917050.745135:0:14899:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788917050.745703:0:14899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 491: rc = 0 00100000:10000000:1.0:1788917050.745802:0:14899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 491: rc = 0 00100000:10000000:1.0:1788917050.745900:0:14899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 491: rc = 0 00100000:10000000:1.0:1788917050.746426:0:14899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 631: rc = 0 00100000:10000000:1.0:1788917050.746886:0:14899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 631: rc = 0 00100000:10000000:1.0:1788917050.748393:0:14899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 631: rc = 0 00100000:10000000:1.0:1788917050.748714:0:14899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 631: rc = 0 00100000:10000000:1.0:1788917050.749010:0:14899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 631: rc = 0 00100000:10000000:1.0:1788917050.749304:0:14899:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 631: rc = 0 00000020:00000080:1.0:1788917050.751289:0:14899:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788917050.751302:0:14899:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788917050.751321:0:14899:0:(genops.c:1407:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x51de7f756a83e7f9 00000020:01000004:1.0:1788917050.751331:0:14899:0:(tgt_mount.c:2677:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788917050.751357:0:14899:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788917050.751361:0:14899:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788917050.751366:0:14899:0:(tgt_mount.c:1890:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788917050.751369:0:14899:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788917050.751384:0:14899:0:(genops.c:414:class_newdev()) Allocate new device OSS (ffff9a6e0a73b380) 00000020:00000080:1.0:1788917050.751397:0:14899:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1788917050.752618:0:14899:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788917050.752791:0:14899:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788917050.752798:0:14899:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788917050.753685:0:14899:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788917050.753693:0:14899:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788917050.759284:0:14899:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788917050.759306:0:14899:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788917050.760763:0:14899:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788917050.760996:0:14899:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788917050.761006:0:14899:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788917050.762548:0:14899:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788917050.762570:0:14899:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788917050.782773:0:14899:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788917050.783052:0:14899:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788917050.783060:0:14899:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788917050.785467:0:14899:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788917050.785484:0:14899:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788917050.786573:0:14899:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788917050.786584:0:14899:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788917050.796205:0:14899:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788917050.796447:0:14899:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788917050.796455:0:14899:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788917050.798134:0:14899:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788917050.798187:0:14899:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788917050.838363:0:14899:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788917050.838603:0:14899:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788917050.838611:0:14899:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788917050.840244:0:14899:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788917050.840258:0:14899:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788917050.840702:0:14899:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788917050.840729:0:14899:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788917050.840737:0:14899:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788917050.848916:0:14899:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788917050.848957:0:14899:0:(tgt_mount.c:1493:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.140@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788917050.849031:0:14899:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788917050.849033:0:14899:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788917050.849034:0:14899:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788917050.849035:0:14899:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788917050.849037:0:14899:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788917050.849038:0:14899:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788917050.849040:0:14899:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788917050.849042:0:14899:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788917050.849044:0:14899:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788917050.849049:0:14899:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788917050.849051:0:14899:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788917050.849052:0:14899:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788917050.849052:0:14899:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788917050.849053:0:14899:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788917050.849054:0:14899:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788917050.849054:0:14899:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788917050.849055:0:14899:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788917050.849056:0:14899:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788917050.849057:0:14899:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788917050.849100:0:14899:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788917050.849123:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140776320:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788917050.849255:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917050.849358:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e1ed5ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788917050.849457:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140776320 00000100:00100000:0.0:1788917050.849465:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140776320 00000100:00100000:0.0:1788917050.849610:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788917050.849620:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14899:x1875815140776320:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788917050.849662:0:14257:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788917050.849664:0:14257:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788917050.849668:0:14257:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788917050.858985:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14899:x1875815140776320:12345-0@lo:253:mount.lustre.0 Request processed in 9336us (9699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917050.859005:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788917050.859186:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140776320:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788917050.859208:0:14899:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788917050.859213:0:14899:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788917050.859214:0:14899:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788917050.859237:0:14899:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788917050.859239:0:14899:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788917050.859240:0:14899:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788917050.859241:0:14899:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788917050.859243:0:14899:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788917050.859245:0:14899:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788917050.859246:0:14899:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788917050.859271:0:14899:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a6e3fe0e800 from lustre-OST0000 10000000:01000000:0.0:1788917050.859311:0:14899:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788917050.859314:0:14899:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788917050.859323:0:14899:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a6e2cd0cd40 local copy 00010000:00010000:0.0:1788917050.859338:0:14899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83e6ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e6f6 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917050.860418:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140776448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788917050.860490:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917050.860617:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e408fec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788917050.861217:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140776448 00000100:00100000:3.0:1788917050.861227:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140776448 00000100:00100000:3.0:1788917050.861344:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788917050.861356:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14899:x1875815140776448:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788917050.861685:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14899:x1875815140776448:12345-0@lo:501:mount.lustre.0 Request processed in 329us (1192us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788917050.861692:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788917050.861792:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140776448:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788917050.861819:0:14899:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788917050.862005:0:14899:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788917050.862015:0:14899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83e6ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e6f6 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917050.862026:0:14899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83e6ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e6f6 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788917050.862059:0:14899:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a6e3fe0e800 10000000:01000000:0.0:1788917050.862065:0:14899:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788917050.862071:0:14899:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a6e2cd0cd40 10000000:01000000:0.0:1788917050.862073:0:14899:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788917050.862076:0:14899:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9a6e2cd0cd40 from 1 10000000:01000000:0.0:1788917050.862087:0:14899:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788917050.862132:0:14899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3c00/0x51de7f756a83e807 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917050.862140:0:14899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3c00/0x51de7f756a83e807 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917050.862172:0:14899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3c00/0x51de7f756a83e807 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917050.862188:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140776576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788917050.862217:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917050.862764:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140776576 00000100:00100000:2.0:1788917050.862772:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140776576 00000100:00100000:2.0:1788917050.862812:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788917050.862820:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+12:14899:x1875815140776576:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788917050.862840:0:14258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917050.862860:0:14258:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e00031400/0x51de7f756a83e80e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83e807 expref: -99 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917050.862887:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00031400/0x51de7f756a83e80e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83e807 expref: 13 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917050.862896:0:14258:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e00031400/0x51de7f756a83e80e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e807 expref: 13 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917050.862906:0:14258:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031400, rc 0) 00000100:00100000:2.0:1788917050.862936:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+13:14899:x1875815140776576:12345-0@lo:101:mount.lustre.0 Request processed in 118us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917050.862942:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788917050.863118:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e408fec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788917050.863140:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140776576:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788917050.863223:0:14899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3c00/0x51de7f756a83e807 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e80e expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917050.863233:0:14899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3c00/0x51de7f756a83e807 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83e80e expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788917050.863255:0:14899:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788917050.863306:0:14899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3c00/0x51de7f756a83e807 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e80e expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917050.863315:0:14899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3c00/0x51de7f756a83e807 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e80e expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788917050.863324:0:14899:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788917050.863329:0:14899:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788917050.863334:0:14899:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788917050.863337:0:14899:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788917050.863357:0:14899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa600/0x51de7f756a83e815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917050.863371:0:14899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa600/0x51de7f756a83e815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917050.863380:0:14899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa600/0x51de7f756a83e815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917050.863395:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140776704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788917050.863426:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917050.863453:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e096e3540 going to sleep for 11 seconds 00000100:00100000:2.0:1788917050.863506:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140776704 00000100:00100000:2.0:1788917050.863510:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140776704 00000100:00100000:2.0:1788917050.863659:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788917050.863667:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+13:14899:x1875815140776704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788917050.863676:0:14258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917050.863686:0:14258:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83e81c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83e815 expref: -99 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917050.863702:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83e81c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83e815 expref: 14 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917050.863710:0:14258:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e00031c00/0x51de7f756a83e81c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e815 expref: 14 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917050.863717:0:14258:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031c00, rc 0) 00000100:00100000:2.0:1788917050.863805:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+14:14899:x1875815140776704:12345-0@lo:101:mount.lustre.0 Request processed in 138us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917050.863811:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788917050.863935:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140776704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788917050.863947:0:14899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa600/0x51de7f756a83e815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e81c expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917050.863954:0:14899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa600/0x51de7f756a83e815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83e81c expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788917050.865332:0:14899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788917050.866283:0:14899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788917050.866546:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788917050.866695:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788917050.866726:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788917050.866770:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788917050.866808:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788917050.866839:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788917050.866899:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788917050.866907:0:14899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788917050.867062:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140776832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788917050.867138:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917050.867389:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e096e3900 going to sleep for 11 seconds 00000100:00100000:2.0:1788917050.867440:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140776832 00000100:00100000:2.0:1788917050.867448:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140776832 00000100:00100000:2.0:1788917050.867633:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788917050.867644:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+14:14899:x1875815140776832:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788917050.868281:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+14:14899:x1875815140776832:12345-0@lo:501:mount.lustre.0 Request processed in 637us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917050.868291:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788917050.868365:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140776832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788917050.868422:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140776960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788917050.868472:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917050.868702:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e096e3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788917050.868743:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140776960 00000100:00100000:3.0:1788917050.868749:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140776960 00000100:00100000:3.0:1788917050.868821:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788917050.868830:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+14:14899:x1875815140776960:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788917050.869324:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+14:14899:x1875815140776960:12345-0@lo:503:mount.lustre.0 Request processed in 494us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917050.869333:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788917050.869431:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140776960:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788917050.870858:0:14899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788917050.871134:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140777088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788917050.871321:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917050.871408:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e1ed5f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788917050.871501:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140777088 00000100:00100000:3.0:1788917050.871509:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140777088 00000100:00100000:2.0:1788917050.871648:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788917050.871659:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+14:14899:x1875815140777088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788917050.871939:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+14:14899:x1875815140777088:12345-0@lo:502:mount.lustre.0 Request processed in 281us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917050.871948:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788917050.872036:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140777088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788917050.872373:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788917050.872431:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788917050.872467:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788917050.872518:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788917050.872555:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788917050.872950:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788917050.873209:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788917050.873249:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788917050.873286:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788917050.873333:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788917050.873370:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788917050.873418:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788917050.873469:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140777216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788917050.873541:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917050.873673:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140777216 00000100:00100000:3.0:1788917050.873681:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140777216 00000100:00100000:3.0:1788917050.873719:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788917050.873728:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+14:14899:x1875815140777216:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788917050.873918:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+14:14899:x1875815140777216:12345-0@lo:502:mount.lustre.0 Request processed in 191us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917050.873925:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788917050.874138:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e1ed5f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788917050.874230:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140777216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788917050.874309:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788917050.874319:0:14899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788917050.875669:0:14913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788917050.875682:0:14913:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788917050.875690:0:14913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788917050.875694:0:14913:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788917050.875703:0:14913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788917050.875726:0:14913:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0000 (ffff9a6e2cd08000) 00000020:00000080:3.0:1788917050.875753:0:14913:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788917050.875760:0:14913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788917050.875864:0:14913:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6e3fe0e800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788917050.875877:0:14913:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788917050.875886:0:14913:0:(genops.c:1407:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x51de7f756a83e82a 00010000:00010000:3.0:1788917050.882109:0:14913:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788917050.882593:0:14913:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788917050.885863:0:14913:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788917050.890691:0:14913:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788917050.890711:0:14913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788917050.890720:0:14913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788917050.890722:0:14913:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788917050.890726:0:14913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788917050.890729:0:14913:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788917050.890730:0:14913:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788917050.890732:0:14913:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788917050.890734:0:14913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788917050.890736:0:14913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788917050.890738:0:14913:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788917050.890740:0:14913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788917050.890742:0:14913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788917050.890744:0:14913:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788917050.890747:0:14913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788917050.890749:0:14913:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788917050.890751:0:14913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788917050.890753:0:14913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788917050.890768:0:14913:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788917050.890772:0:14913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788917050.890775:0:14913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788917050.890777:0:14913:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788917050.890779:0:14913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788917050.890873:0:14913:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788917050.890876:0:14913:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788917050.890878:0:14913:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788917050.890881:0:14913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788917050.891055:0:14899:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788917050.891229:0:14899:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788917050.891280:0:14899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa600/0x51de7f756a83e815 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e81c expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.891309:0:14899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeaa600/0x51de7f756a83e815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e81c expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788917050.891330:0:14899:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e3fe0e800 from 1 10000000:01000000:3.0:1788917050.891339:0:14899:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788917050.891420:0:14899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18e800/0x51de7f756a83e831 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.891439:0:14899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18e800/0x51de7f756a83e831 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.891537:0:14899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18e800/0x51de7f756a83e831 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917050.891586:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140777344:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788917050.891726:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917050.891822:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788917050.892878:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140777344 00000100:00100000:2.0:1788917050.892892:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140777344 00000100:00100000:2.0:1788917050.892976:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788917050.892988:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+14:14899:x1875815140777344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788917050.893011:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917050.893034:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e838 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83e831 expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917050.893093:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e838 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83e831 expref: 15 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917050.893105:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e838 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e831 expref: 15 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917050.893115:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00030a00, rc 0) 00000100:00100000:2.0:1788917050.893226:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+15:14899:x1875815140777344:12345-0@lo:101:mount.lustre.0 Request processed in 240us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917050.893235:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788917050.893314:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140777344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788917050.893339:0:14899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18e800/0x51de7f756a83e831 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e838 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.893374:0:14899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18e800/0x51de7f756a83e831 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83e838 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788917050.893936:0:14899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788917050.894334:0:14899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788917050.894687:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788917050.894763:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788917050.894848:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788917050.894857:0:14899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788917050.894929:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140777472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788917050.895011:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917050.895056:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788917050.897241:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140777472 00000100:00100000:2.0:1788917050.897259:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140777472 00000100:00100000:2.0:1788917050.897333:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788917050.897345:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+15:14899:x1875815140777472:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788917050.897862:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+15:14899:x1875815140777472:12345-0@lo:501:mount.lustre.0 Request processed in 517us (2848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917050.897872:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788917050.897900:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140777472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788917050.897981:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140777600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788917050.898058:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917050.898122:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788917050.899189:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140777600 00000100:00100000:2.0:1788917050.899198:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140777600 00000100:00100000:2.0:1788917050.899252:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788917050.899262:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+15:14899:x1875815140777600:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788917050.899498:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+15:14899:x1875815140777600:12345-0@lo:503:mount.lustre.0 Request processed in 238us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917050.899506:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788917050.899921:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140777600:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788917050.901217:0:14899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788917050.901311:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140777728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788917050.902081:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917050.903904:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788917050.905463:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140777728 00000100:00100000:1.0:1788917050.905474:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140777728 00000100:00100000:1.0:1788917050.905625:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788917050.905636:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+15:14899:x1875815140777728:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788917050.905907:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+15:14899:x1875815140777728:12345-0@lo:502:mount.lustre.0 Request processed in 273us (3827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917050.905915:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788917050.906046:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140777728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788917050.906473:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788917050.906601:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788917050.906660:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788917050.906708:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788917050.906741:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788917050.907079:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788917050.907122:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788917050.907313:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788917050.907367:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140777856:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788917050.907439:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917050.907481:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788917050.907575:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140777856 00000100:00100000:2.0:1788917050.907583:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140777856 00000100:00100000:2.0:1788917050.907635:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788917050.907643:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+15:14899:x1875815140777856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788917050.907841:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+15:14899:x1875815140777856:12345-0@lo:502:mount.lustre.0 Request processed in 198us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917050.907849:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788917050.907985:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140777856:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788917050.908083:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788917050.908095:0:14899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788917050.909024:0:14917:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788917050.909036:0:14917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788917050.909038:0:14917:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788917050.909045:0:14917:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6e3fe0e800 00000020:00000080:3.0:1788917050.909107:0:14917:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788917050.909118:0:14917:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788917050.909121:0:14917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788917050.909122:0:14917:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788917050.909124:0:14917:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788917050.909126:0:14917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788917050.909127:0:14917:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788917050.909129:0:14917:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6e3fe0e800 00000020:00000080:3.0:1788917050.909131:0:14917:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788917050.909219:0:14917:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788917050.909222:0:14917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788917050.909224:0:14917:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788917050.909226:0:14917:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788917050.909228:0:14917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788917050.909230:0:14917:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788917050.909234:0:14917:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a6e3fe0e800 00000020:00000080:3.0:1788917050.909235:0:14917:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788917050.909268:0:14917:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788917050.909270:0:14917:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788917050.909271:0:14917:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788917050.909273:0:14917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788917050.909340:0:14899:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788917050.909373:0:14899:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788917050.909401:0:14899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18e800/0x51de7f756a83e831 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e838 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917050.909414:0:14899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18e800/0x51de7f756a83e831 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e838 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788917050.909463:0:14899:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788917050.909466:0:14899:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a6e3fe0e800 10000000:01000000:1.0:1788917050.909469:0:14899:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a6e3fe0e800 10000000:01000000:1.0:1788917050.909474:0:14899:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788917050.909479:0:14899:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a6e3fe0e800 from 1 10000000:01000000:1.0:1788917050.909482:0:14899:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788917050.909514:0:14899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83e83f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917050.909550:0:14899:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83e83f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917050.909564:0:14899:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83e83f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917050.909590:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a683480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140777984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788917050.909652:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917050.909708:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36436480 going to sleep for 11 seconds 00000100:00100000:3.0:1788917050.909819:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140777984 00000100:00100000:3.0:1788917050.909825:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140777984 00000100:00100000:3.0:1788917050.909875:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788917050.909885:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+15:14899:x1875815140777984:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788917050.909899:0:14258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917050.909912:0:14258:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e2d18e200/0x51de7f756a83e846 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83e83f expref: -99 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.909936:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e2d18e200/0x51de7f756a83e846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83e83f expref: 16 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.909948:0:14258:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e2d18e200/0x51de7f756a83e846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e83f expref: 16 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.909957:0:14258:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e200, rc 0) 00000100:00100000:3.0:1788917050.910019:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:14899:x1875815140777984:12345-0@lo:101:mount.lustre.0 Request processed in 135us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917050.910028:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788917050.910256:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a683480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140777984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788917050.910279:0:14899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83e83f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e846 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917050.910291:0:14899:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83e83f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83e846 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788917050.913106:0:14899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788917050.913632:0:14899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788917050.914420:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788917050.914511:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788917050.914585:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788917050.914688:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788917050.914783:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788917050.914902:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788917050.915906:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788917050.916030:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788917050.916119:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788917050.916752:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788917050.916807:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788917050.916899:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788917050.916949:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788917050.917022:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788917050.917128:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788917050.917282:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788917050.917393:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788917050.917515:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788917050.917781:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788917050.917855:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788917050.917990:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788917050.918074:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788917050.918253:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788917050.918363:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788917050.918412:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788917050.918463:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788917050.919026:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788917050.919178:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788917050.919516:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788917050.919619:0:14899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788917050.919831:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140778112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788917050.919944:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917050.920262:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6180 going to sleep for 11 seconds 00000100:00100000:3.0:1788917050.921304:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140778112 00000100:00100000:3.0:1788917050.921315:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140778112 00000100:00100000:3.0:1788917050.921409:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788917050.921428:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:14899:x1875815140778112:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788917050.922068:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:14899:x1875815140778112:12345-0@lo:501:mount.lustre.0 Request processed in 645us (2128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917050.922092:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788917050.926131:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140778112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788917050.926198:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140778240:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788917050.926389:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917050.926435:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788917050.926460:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140778240 00000100:00100000:0.0:1788917050.926474:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140778240 00000100:00100000:0.0:1788917050.926539:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788917050.926548:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:14899:x1875815140778240:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788917050.926800:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:14899:x1875815140778240:12345-0@lo:503:mount.lustre.0 Request processed in 253us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917050.926808:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788917050.927202:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140778240:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788917050.928324:0:14899:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788917050.928433:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140778368:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788917050.928503:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917050.928636:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140778368 00000100:00100000:3.0:1788917050.928644:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140778368 00000100:00100000:3.0:1788917050.928702:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788917050.928713:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:14899:x1875815140778368:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788917050.929073:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:14899:x1875815140778368:12345-0@lo:502:mount.lustre.0 Request processed in 359us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917050.929084:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788917050.929195:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6180 going to sleep for 11 seconds 00000100:00100000:3.0:1788917050.929217:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140778368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788917050.929808:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788917050.929958:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788917050.930033:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788917050.930114:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788917050.930212:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788917050.930292:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788917050.930349:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788917050.930403:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788917050.930478:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788917050.930531:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788917050.930650:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788917050.930723:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788917050.930779:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788917050.930827:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788917050.930932:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788917050.930998:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788917050.931044:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788917050.931115:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788917050.931203:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788917050.931240:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788917050.931302:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788917050.931356:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788917050.931401:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788917050.931513:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788917050.931722:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788917050.931777:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788917050.931846:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788917050.931898:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788917050.931937:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788917050.932035:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788917050.932259:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788917050.932339:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788917050.932435:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788917050.932960:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788917050.933042:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788917050.933202:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788917050.933334:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788917050.937247:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788917050.937423:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788917050.937471:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788917050.937538:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140778496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788917050.937633:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917050.937710:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788917050.937804:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140778496 00000100:00100000:2.0:1788917050.937812:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140778496 00000100:00100000:3.0:1788917050.937927:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788917050.937940:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:14899:x1875815140778496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788917050.938340:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:14899:x1875815140778496:12345-0@lo:502:mount.lustre.0 Request processed in 402us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917050.938348:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788917050.938422:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140778496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788917050.938497:0:14899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788917050.938509:0:14899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788917050.943238:0:14922:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788917050.943261:0:14922:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a6e2cd099c0) 00000020:00000080:3.0:1788917050.943298:0:14922:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788917050.943516:0:14922:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6e3fe0e800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788917050.943522:0:14922:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6e3fe0e800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788917050.943525:0:14922:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6e3fe0e800 3 00010000:00080000:3.0:1788917050.943595:0:14922:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6e1ea0d000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1788917050.945594:0:14922:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788917050.945687:0:14922:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788917050.945744:0:14922:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788917050.945759:0:14922:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x51de7f756a83e854 00000100:00080000:3.0:1788917050.945768:0:14922:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788917050.945772:0:14922:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a6e1ea0d000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1788917050.945812:0:14922:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e37136a00 x1875815140778624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788917050.945838:0:14922:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788917050.946223:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875815140778624:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788917050.946294:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917050.946374:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140778624 00000100:00100000:1.0:1788917050.946383:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140778624 00000100:00100000:1.0:1788917050.946415:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788917050.946423:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875815140778624:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788917050.946445:0:14264:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 446 last 0 00000040:00080000:3.0:1788917050.946471:0:14922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:00000080:1.0:1788917050.946476:0:14264:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x51de7f756a83e85b 00000004:00100000:1.0:1788917050.946490:0:14264:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788917050.946518:0:14264:0:(import.c:65:import_set_state_nolock()) ffff9a6e08280000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788917050.946573:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875815140778624:12345-0@lo:38:llog_process_th.0 Request processed in 149us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917050.946589:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788917050.946630:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a6e37136a00 x1875815140778624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788917060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788917050.946642:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788917050.946650:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788917050.946658:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788917050.946662:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788917050.946664:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e1ea0d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788917050.946669:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875815140778624:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788917050.947380:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788917050.947391:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788917050.947394:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788917050.947398:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788917050.947491:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140778752:0@lo:400:kworker.0 00000020:01000000:2.0:1788917050.947537:0:14899:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00000100:00100000:1.0:1788917050.947547:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1788917050.947591:0:14899:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788917050.947616:0:14899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83e83f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e846 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917050.947617:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140778752 00000100:00100000:1.0:1788917050.947627:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140778752 00010000:00010000:2.0:1788917050.947630:0:14899:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeab200/0x51de7f756a83e83f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e846 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917050.947676:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:01000004:2.0:1788917050.947688:0:14899:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788917050.947694:0:14899:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788917050.947698:0:14899:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:1.0:1788917050.947699:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140778752:12345-0@lo:400:kworker.0 00000020:01000004:2.0:1788917050.947700:0:14899:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788917050.947701:0:14899:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788917050.947706:0:14899:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788917050.947710:0:14899:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788917050.947717:0:14899:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788917050.947719:0:14899:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788917050.947723:0:14899:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788917050.947726:0:14899:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788917050.947727:0:14899:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788917050.947728:0:14899:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788917050.947729:0:14899:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788917050.947729:0:14899:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788917050.947730:0:14899:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788917050.947732:0:14899:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788917050.947734:0:14899:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788917050.947735:0:14899:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788917050.947752:0:14899:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788917050.947768:0:14899:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140778880:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788917050.947770:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140778752:12345-0@lo:400:kworker.0 Request processed in 78us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917050.947780:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788917050.947820:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a6e28d61500 x1875815140778752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788917066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788917050.947833:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140778752:0@lo:400:kworker.0 00000100:00100000:2.0:1788917050.947841:0:14899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917050.947885:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140778880 00000100:00100000:2.0:1788917050.947888:0:14899:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e1ed5fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788917050.947894:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140778880 00000100:00100000:3.0:1788917050.947943:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788917050.947955:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:14899:x1875815140778880:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788917050.947990:0:14257:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788917050.948009:0:14257:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788917050.977260:0:14257:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788917050.977279:0:14257:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788917050.977290:0:14280:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788917050.977297:0:14280:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788917050.977325:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e862 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917050.977349:0:14280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e00031600/0x51de7f756a83e7cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e7c8 expref: 16 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917050.977377:0:14280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e862 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917050.977425:0:14280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e00031600/0x51de7f756a83e7cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83e7c8 expref: 16 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917050.977442:0:14280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6e00031600/0x51de7f756a83e7cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83e7c8 expref: 16 pid: 14258 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917050.977514:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14280:1875815140779008:0@lo:104: 00000100:00100000:2.0:1788917050.977648:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917050.977695:0:14248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140779008 00000100:00100000:2.0:1788917050.977701:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06fedc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788917050.977704:0:14248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140779008 00000100:00100000:3.0:1788917050.977749:0:14248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788917050.977759:0:14248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+3:14280:x1875815140779008:12345-0@lo:104: 00000100:00100000:2.0:1788917050.977772:0:14249:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:3.0:1788917050.977774:0:14248:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3600/0x51de7f756a83e7c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83e7cf expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917050.977779:0:14249:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1788917050.978107:0:14248:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788917050.978110:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14280:1875815140779008:0@lo:104: 00000100:00100000:3.0:1788917050.978113:0:14248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+3:14280:x1875815140779008:12345-0@lo:104: Request processed in 356us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917050.978120:0:14248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788917050.978139:0:14280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e862 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.978165:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917050.978171:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3600/0x51de7f756a83e7c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83e7cf expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.978179:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3600 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1788917050.978183:0:14253:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3600/0x51de7f756a83e7c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83e7cf expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.978192:0:14253:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3600/0x51de7f756a83e7c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83e7cf expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788917050.978207:0:14253:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3600/0x51de7f756a83e7c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83e7cf expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788917050.978212:0:14253:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788917050.978245:0:14253:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3600/0x51de7f756a83e7c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e7cf expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.978251:0:14253:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788917050.978391:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3600/0x51de7f756a83e7c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e7cf expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.978400:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3600/0x51de7f756a83e7c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e7cf expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.978419:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917050.978421:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917050.978422:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917050.978463:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788917050.978484:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140779136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788917050.978524:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917050.978623:0:14252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140779136 00000100:00100000:3.0:1788917050.978627:0:14252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140779136 00010000:00010000:3.0:1788917050.978646:0:14252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e00031600/0x51de7f756a83e7cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83e7c8 expref: 17 pid: 14258 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917050.978673:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788917050.978680:0:14252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a683b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:3304:x1875815140779136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788917050.978693:0:14252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917050.978699:0:14252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e00031600/0x51de7f756a83e7cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83e7c8 expref: 17 pid: 14258 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.978709:0:14252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e00031600/0x51de7f756a83e7cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83e7c8 expref: 17 pid: 14258 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.978730:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e00031600/0x51de7f756a83e7cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83e7c8 expref: 17 pid: 14258 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.978746:0:14252:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e862 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.978751:0:14252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e862 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788917050.978762:0:14252:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002008517s 00010000:00010000:3.0:1788917050.978765:0:14252:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e862 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.978770:0:14252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e862 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.978775:0:14252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e862 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.978778:0:14252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e862 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.978781:0:14252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917050.978784:0:14252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e862 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.978789:0:14252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e862 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.978802:0:14252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e862 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917050.978816:0:14252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788917050.978820:0:14280:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e862 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917050.978827:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e862 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917050.978833:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e862 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917050.978844:0:14252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a683b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:3304:x1875815140779136:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917050.978851:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788917050.978875:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140779136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788917050.984818:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+15:14899:x1875815140778880:12345-0@lo:253:mount.lustre.0 Request processed in 36857us (36972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917050.984852:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788917050.984926:0:14899:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14899:1875815140778880:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788917050.984943:0:14899:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788917050.984946:0:14899:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788917050.984948:0:14899:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788917050.984949:0:14899:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788917050.984950:0:14899:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788917050.984951:0:14899:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788917050.984952:0:14899:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788917050.984953:0:14899:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788917050.984955:0:14899:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788917050.984956:0:14899:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788917050.984993:0:14899:0:(tgt_mount.c:2781:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788917050.989503:0:14899:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788917050.989653:0:14899:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788917050.989779:0:14899:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788917050.989871:0:14899:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788917050.990009:0:14899:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788917050.990273:0:14899:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788917050.991132:0:14899:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788917051.031022:0:14899:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788917051.031035:0:14899:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788917051.031082:0:14899:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788917051.031210:0:14899:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788917051.031231:0:14899:0:(tgt_mount.c:2550:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788917051.031279:0:14899:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788917051.298494:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788917052.128136:0:14262:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788917052.128166:0:14262:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a6e05362800 from 7 10000000:01000000:2.0:1788917052.128174:0:14262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788917052.128253:0:14262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83e869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917052.128269:0:14262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83e869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917052.128282:0:14262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83e869 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917052.128316:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140779264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788917052.128406:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917052.128472:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788917052.128678:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140779264 00000100:00100000:3.0:1788917052.128688:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140779264 00000100:00100000:3.0:1788917052.128762:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788917052.128772:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+15:14262:x1875815140779264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788917052.128790:0:14258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917052.128807:0:14258:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e2d18f800/0x51de7f756a83e870 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83e869 expref: -99 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917052.128835:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e2d18f800/0x51de7f756a83e870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83e869 expref: 16 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917052.128845:0:14258:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e2d18f800/0x51de7f756a83e870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e869 expref: 16 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917052.128854:0:14258:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f800, rc 0) 00000100:00100000:3.0:1788917052.128893:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:14262:x1875815140779264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917052.128900:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788917052.128948:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140779264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788917052.128976:0:14262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83e869 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e870 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917052.129005:0:14262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83e869 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83e870 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917052.129054:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140779392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788917052.129081:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917052.129098:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e032f30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788917052.129337:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140779392 00000100:00100000:2.0:1788917052.129342:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140779392 00000100:00100000:2.0:1788917052.129370:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788917052.129376:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:14262:x1875815140779392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788917052.129392:0:14259:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788917052.129413:0:14259:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788917052.129419:0:14259:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788917052.129496:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:14262:x1875815140779392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917052.129502:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788917052.129739:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140779392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788917052.129798:0:14262:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788917052.129805:0:14262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83e869 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e870 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917052.129812:0:14262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83e869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e870 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917052.320363:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917053.024290:0:3303:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788917043/real 1788917043] req@ffff9a6e3fcb8e00 x1875815140772864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788917053 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788917053.024322:0:3303:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a6e3fcb8e00 x1875815140772864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788917053 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788917053.024333:0:3303:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788917043/real 1788917043] req@ffff9a6e3fcbad80 x1875815140772736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788917053 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788917053.024346:0:3303:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a6e3fcbad80 x1875815140772736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788917053 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788917053.024365:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e06d91000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788917053.024387:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788917053.024391:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140772864:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788917053.024398:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e111ab800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788917053.024403:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788917053.024406:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140772736:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788917053.024526:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788917053.024531:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788917053.024534:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a6e111ab800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788917053.024539:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 439 00000100:00080000:0.0:1788917053.024543:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788917053.024549:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a6e111ab800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1788917053.024569:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e3fcb8380 x1875815140779648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788917053.024582:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788917053.024585:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788917053.024586:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a6e06d91000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788917053.024590:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 439 00000100:00080000:0.0:1788917053.024593:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788917053.024596:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a6e06d91000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1788917053.024607:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e3fcbbb80 x1875815140779776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788917053.024646:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788917053.024658:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875815140780032:0@lo:400:kworker.0 00000100:00100000:0.0:1788917053.024726:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917053.024797:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140780032 00000100:00100000:0.0:1788917053.024805:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140780032 00000100:00100000:0.0:1788917053.024860:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788917053.024869:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875815140780032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917053.024922:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875815140780032:12345-0@lo:400:kworker.0 Request processed in 53us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917053.024929:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788917053.024975:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788917053.025002:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e3fcb8a80 x1875815140780032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788917069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788917053.025015:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875815140780032:0@lo:400:kworker.0 00000100:00100000:1.0:1788917053.025069:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140779904:0@lo:400:kworker.0 00000100:00100000:1.0:1788917053.025097:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917053.025127:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788917053.025134:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140779520:0@lo:400:kworker.0 00000100:00100000:1.0:1788917053.025187:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917053.025217:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140779520 00000100:00100000:1.0:1788917053.025222:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140779520 00000100:00100000:1.0:1788917053.025252:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788917053.025258:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:3307:x1875815140779520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917053.025292:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:3307:x1875815140779520:12345-0@lo:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917053.025299:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788917053.025336:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140779520:0@lo:400:kworker.0 00000100:00100000:0.0:1788917053.025397:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140779904 00000100:00100000:0.0:1788917053.025402:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140779904 00000100:00100000:0.0:1788917053.025433:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788917053.025440:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140779904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917053.025475:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140779904:12345-0@lo:400:kworker.0 Request processed in 36us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917053.025481:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788917053.025503:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e3fcb8700 x1875815140779904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788917069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788917053.025512:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140779904:0@lo:400:kworker.0 00000100:00100000:3.0:1788917053.025583:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140779648:0@lo:8:kworker.0 00000100:00100000:3.0:1788917053.025619:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917053.025654:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140779776:0@lo:8:kworker.0 00000100:00100000:3.0:1788917053.025675:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917053.025741:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140779648 00000100:00100000:1.0:1788917053.025745:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140779648 00000100:00100000:1.0:1788917053.025768:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140779776 00000100:00100000:1.0:1788917053.025771:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140779776 00000100:00100000:1.0:1788917053.025782:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788917053.025786:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1875815140779648:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788917053.025811:0:14901:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:1.0:1788917053.025844:0:14901:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x51de7f756a83e877 00002000:00100000:1.0:1788917053.025859:0:14901:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a6e08284800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211371a ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788917053.025864:0:14901:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788917053.025873:0:14901:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788917053.026288:0:14901:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788917053.026316:0:14901:0:(import.c:65:import_set_state_nolock()) ffff9a6e08285000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788917053.026362:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875815140779648:12345-0@lo:8:kworker.0 Request processed in 574us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917053.026368:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788917053.026382:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788917053.026386:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1875815140779776:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788917053.026395:0:14901:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788917053.026420:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1875815140779776:12345-0@lo:8:kworker.0 Request processed in 33us (744us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788917053.026425:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788917053.026621:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e3fcb8380 x1875815140779648/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788917068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788917053.026632:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788917053.026639:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788917053.026648:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788917053.026654:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788917053.026657:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e111ab800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788917053.026677:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788917053.026682:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140779648:0@lo:8:kworker.0 00000100:00080000:3.0:1788917053.026693:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e06d91000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788917053.026697:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788917053.026699:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140779776:0@lo:8:kworker.0 00000004:00080000:1.0:1788917053.029109:0:14287:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788917053.029137:0:14287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14287:1875815140780288:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788917053.029237:0:14287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917053.029266:0:14287:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e2cf08b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788917053.029283:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788917053.029294:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140780160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917053.029332:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917053.029361:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140780288 00000100:00100000:1.0:1788917053.029367:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140780288 00000100:00100000:1.0:1788917053.029418:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788917053.029426:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14287:x1875815140780288:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1788917053.030020:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788917053.031414:0:14286:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788917053.032385:0:14286:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 449064237822ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788917053.032436:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140780160 00000100:00100000:2.0:1788917053.032456:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140780160 00000100:00100000:2.0:1788917053.032508:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788917053.032517:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875815140780160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788917053.032550:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917053.032643:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875815140780160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (3308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917053.032650:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788917053.032694:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e3a682680 x1875815140780160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788917069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788917053.032715:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140780160:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1788917053.035628:0:14901:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788917053.035639:0:14901:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788917053.035644:0:14901:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1788917053.040986:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.041003:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e87e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.041020:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.041024:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.041030:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e87e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.041046:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e87e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.041056:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e87e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.041064:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e87e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.041137:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788917053.041703:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.041710:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e885 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.041719:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.041722:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.041726:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e885 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.041736:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e885 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.041749:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e885 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.041756:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e885 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.041877:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788917053.041885:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e87e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.041894:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab800 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917053.041898:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e87e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.041907:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e87e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.041924:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e87e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.041936:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e87e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.042080:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917053.042085:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e885 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.042091:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaac00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917053.042094:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e885 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.042102:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e885 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.042112:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e885 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.042118:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917053.042120:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917053.042122:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917053.042647:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788917053.042653:0:14901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e885 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.042679:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917053.043121:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.043128:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e88c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.043140:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.043163:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.043169:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e88c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.043178:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e88c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.043186:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e88c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.043204:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e88c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.043219:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788917053.043228:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788917053.043232:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e88c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.043240:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaae00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788917053.043244:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e88c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.043252:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e88c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.044353:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e88c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.044363:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e88c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.044379:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917053.044381:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917053.044383:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917053.046412:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.046437:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e893 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.046456:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.046461:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.046469:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e893 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.046485:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e893 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.046498:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e893 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.046506:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e893 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.046529:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788917053.047978:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788917053.047992:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e893 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.048005:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab600 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788917053.048010:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e893 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.048021:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e893 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.048051:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e893 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.048059:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e893 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.048081:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917053.048083:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917053.048086:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788917053.049123:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788917053.049134:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dfe64a6/0x51de7f756a83e89a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.049178:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788917053.049182:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788917053.050796:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dfe64a6/0x51de7f756a83e89a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.050821:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dfe64a6/0x51de7f756a83e89a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.050833:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dfe64a6/0x51de7f756a83e89a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.050841:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dfe64a6/0x51de7f756a83e89a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.050984:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788917053.051413:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788917053.051421:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dfe64a6/0x51de7f756a83e89a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.051431:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2000 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788917053.051436:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dfe64a6/0x51de7f756a83e89a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.051446:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dfe64a6/0x51de7f756a83e89a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.051464:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dfe64a6/0x51de7f756a83e89a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.051471:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dfe64a6/0x51de7f756a83e89a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.051500:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917053.051501:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917053.051503:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788917053.052390:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788917053.052397:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003481f66c/0x51de7f756a83e8a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.052408:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788917053.052412:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788917053.052417:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003481f66c/0x51de7f756a83e8a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.052426:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003481f66c/0x51de7f756a83e8a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.052955:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003481f66c/0x51de7f756a83e8a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.052966:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003481f66c/0x51de7f756a83e8a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.052985:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788917053.054118:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788917053.054127:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003481f66c/0x51de7f756a83e8a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.054135:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3600 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788917053.054139:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003481f66c/0x51de7f756a83e8a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.054160:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003481f66c/0x51de7f756a83e8a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.054177:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003481f66c/0x51de7f756a83e8a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.054185:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003481f66c/0x51de7f756a83e8a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.054208:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917053.054211:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917053.054214:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788917053.055665:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788917053.055676:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.055689:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788917053.055693:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788917053.055699:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.055710:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.055719:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.055727:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.055751:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788917053.055760:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788917053.055765:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.055772:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2a00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788917053.055775:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.055783:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.055795:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.055801:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.055813:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917053.055815:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917053.055816:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788917053.057022:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788917053.057031:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e8af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.057045:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788917053.057915:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788917053.057923:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e8af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.057939:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e8af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.057959:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e8af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.057967:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e8af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.058016:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788917053.058028:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788917053.058033:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e8af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.058041:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee3400 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788917053.058046:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e8af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.058374:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e8af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.058390:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e8af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.058407:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c92d7a2/0x51de7f756a83e8af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.058425:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917053.058427:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917053.058429:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788917053.061237:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788917053.061429:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd09318f/0x51de7f756a83e8b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.061512:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788917053.061520:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788917053.061528:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd09318f/0x51de7f756a83e8b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.061545:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd09318f/0x51de7f756a83e8b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.061558:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd09318f/0x51de7f756a83e8b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.061627:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd09318f/0x51de7f756a83e8b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.061644:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788917053.061671:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788917053.061680:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd09318f/0x51de7f756a83e8b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.061699:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2e00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788917053.061703:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd09318f/0x51de7f756a83e8b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.061713:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd09318f/0x51de7f756a83e8b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.061736:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd09318f/0x51de7f756a83e8b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.061746:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd09318f/0x51de7f756a83e8b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.061765:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917053.061766:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917053.061768:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788917053.063126:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788917053.063666:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788917053.063676:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.063689:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788917053.063691:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788917053.063696:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.063704:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.063711:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.063715:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.063729:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788917053.063752:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788917053.063759:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.063767:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2a00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788917053.063771:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.063780:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.063801:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.063809:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000782b5e6b/0x51de7f756a83e8bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.063822:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917053.063824:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917053.063825:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788917053.064520:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788917053.064527:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f1e5875/0x51de7f756a83e8c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.064537:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=449s v=(0 0) 00010000:00010000:0.0:1788917053.064540:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788917053.064545:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f1e5875/0x51de7f756a83e8c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.064555:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f1e5875/0x51de7f756a83e8c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.064629:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f1e5875/0x51de7f756a83e8c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.064636:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f1e5875/0x51de7f756a83e8c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.064651:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788917053.064977:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788917053.064983:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f1e5875/0x51de7f756a83e8c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.064990:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e06ee2200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788917053.064994:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f1e5875/0x51de7f756a83e8c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.065002:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f1e5875/0x51de7f756a83e8c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.065013:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f1e5875/0x51de7f756a83e8c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.065019:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f1e5875/0x51de7f756a83e8c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.065041:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917053.065043:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917053.065044:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917053.065388:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.065393:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e8cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.065399:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.065401:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.065405:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e8cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.065410:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e8cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.065415:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e8cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.065420:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e8cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.065433:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788917053.065519:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788917053.065524:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e8cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.065532:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab600 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788917053.065535:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e8cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.065543:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e8cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.065555:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e8cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.065627:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e8cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.065642:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917053.065649:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917053.065651:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917053.065801:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.065805:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e8d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.065818:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.065820:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.065823:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e8d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.065829:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e8d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.065834:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e8d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.065839:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e8d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.065851:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788917053.065871:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788917053.065875:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e8d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.065883:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaae00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788917053.065886:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e8d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.065894:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e8d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.065905:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e8d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.065911:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e8d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.065923:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917053.065925:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917053.065927:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917053.066236:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.066242:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e8d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.066251:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.066254:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.066259:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e8d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.066268:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e8d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.066284:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e8d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.066289:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e8d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.066300:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788917053.066316:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788917053.066321:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e8d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.066328:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaac00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788917053.066332:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e8d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.066345:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e8d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.066356:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e8d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.066363:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000292cc278/0x51de7f756a83e8d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.066376:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917053.066377:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917053.066379:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917053.066635:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.066639:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e8e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.066645:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.066646:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.066649:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e8e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.066655:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e8e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.066659:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e8e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.066664:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e8e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.066684:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788917053.066703:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788917053.066708:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e8e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.066716:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeabe00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788917053.066719:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e8e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.066726:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e8e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.066737:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e8e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.066754:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e8e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917053.066768:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917053.066770:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917053.066771:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917053.067026:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.067032:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d622d5a/0x51de7f756a83e8e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.067041:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.067044:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.067047:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d622d5a/0x51de7f756a83e8e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.067056:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d622d5a/0x51de7f756a83e8e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.067063:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d622d5a/0x51de7f756a83e8e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.067071:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d622d5a/0x51de7f756a83e8e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.067092:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788917053.067471:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.067477:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e924f015/0x51de7f756a83e8ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.067485:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.067493:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.067498:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e924f015/0x51de7f756a83e8ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.067507:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e924f015/0x51de7f756a83e8ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.067514:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e924f015/0x51de7f756a83e8ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.067520:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e924f015/0x51de7f756a83e8ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.067541:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788917053.067746:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788917053.067752:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d622d5a/0x51de7f756a83e8e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.067759:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaa000 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788917053.067763:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d622d5a/0x51de7f756a83e8e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.067770:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d622d5a/0x51de7f756a83e8e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.067784:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d622d5a/0x51de7f756a83e8e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.067792:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d622d5a/0x51de7f756a83e8e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.067807:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788917053.067810:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e924f015/0x51de7f756a83e8ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.067817:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaa400 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788917053.067820:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e924f015/0x51de7f756a83e8ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.067828:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e924f015/0x51de7f756a83e8ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.067849:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e924f015/0x51de7f756a83e8ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.067856:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e924f015/0x51de7f756a83e8ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.067868:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917053.067870:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917053.067872:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917053.067908:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.067914:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539764df/0x51de7f756a83e8f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.067922:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.067925:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.067930:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539764df/0x51de7f756a83e8f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.067939:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539764df/0x51de7f756a83e8f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.067957:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539764df/0x51de7f756a83e8f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.067970:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539764df/0x51de7f756a83e8f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.067989:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788917053.068074:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788917053.068079:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539764df/0x51de7f756a83e8f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.068087:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaa200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788917053.068090:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539764df/0x51de7f756a83e8f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.068099:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539764df/0x51de7f756a83e8f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.068109:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539764df/0x51de7f756a83e8f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.068117:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539764df/0x51de7f756a83e8f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.068141:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917053.068142:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917053.068165:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917053.068412:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.068418:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f1f94da/0x51de7f756a83e8fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.068427:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.068430:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.068435:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f1f94da/0x51de7f756a83e8fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.068443:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f1f94da/0x51de7f756a83e8fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.068453:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f1f94da/0x51de7f756a83e8fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.068460:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f1f94da/0x51de7f756a83e8fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.068478:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788917053.068494:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788917053.068499:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f1f94da/0x51de7f756a83e8fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.068506:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaa800 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788917053.068510:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f1f94da/0x51de7f756a83e8fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.068518:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f1f94da/0x51de7f756a83e8fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.068529:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f1f94da/0x51de7f756a83e8fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.068537:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f1f94da/0x51de7f756a83e8fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.068549:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917053.068551:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917053.068553:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917053.068862:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.068868:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e30d5f1/0x51de7f756a83e903 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.068881:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.068884:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.068889:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e30d5f1/0x51de7f756a83e903 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.068897:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e30d5f1/0x51de7f756a83e903 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.068903:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e30d5f1/0x51de7f756a83e903 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.068907:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e30d5f1/0x51de7f756a83e903 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.068918:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788917053.068938:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788917053.068943:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e30d5f1/0x51de7f756a83e903 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.068973:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab000 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788917053.068976:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e30d5f1/0x51de7f756a83e903 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.068984:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e30d5f1/0x51de7f756a83e903 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.068995:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e30d5f1/0x51de7f756a83e903 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.069001:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e30d5f1/0x51de7f756a83e903 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.069015:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917053.069017:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917053.069018:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917053.069780:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917053.070665:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.070672:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000368beb64/0x51de7f756a83e90a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.070688:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.070691:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.070698:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000368beb64/0x51de7f756a83e90a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.070709:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000368beb64/0x51de7f756a83e90a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.070730:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000368beb64/0x51de7f756a83e90a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.070737:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000368beb64/0x51de7f756a83e90a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.070784:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788917053.071236:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.071242:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e911 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.071251:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.071254:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.071257:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e911 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.071266:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e911 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.071273:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e911 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.071281:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e911 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.071484:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788917053.071493:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000368beb64/0x51de7f756a83e90a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.071502:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaaa00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788917053.071506:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000368beb64/0x51de7f756a83e90a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.071517:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000368beb64/0x51de7f756a83e90a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.071540:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000368beb64/0x51de7f756a83e90a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.071548:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000368beb64/0x51de7f756a83e90a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.071575:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788917053.071579:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e911 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.071586:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaae00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788917053.071589:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e911 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.071598:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e911 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.071608:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e911 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.071617:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917053.071618:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917053.071620:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917053.071784:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788917053.071790:0:14901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff17585f/0x51de7f756a83e911 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788917053.072230:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.072235:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e918 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.072246:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.072249:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.072254:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e918 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.072265:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e918 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.072273:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e918 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.072281:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e918 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.072385:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788917053.072391:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e918 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.072407:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab600 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788917053.072411:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e918 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.072419:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e918 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.072431:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e918 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.072638:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788917053.072643:0:14901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aba6d4b1/0x51de7f756a83e918 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788917053.073091:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.073097:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e91f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.073106:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.073110:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.073115:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e91f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.073124:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e91f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.073133:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e91f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.073141:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e91f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.073210:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917053.073217:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e91f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.073225:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab800 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917053.073233:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e91f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.073241:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e91f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.073254:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e91f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.073262:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917053.073264:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917053.073265:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917053.073265:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917053.073323:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788917053.073328:0:14901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e91f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788917053.073775:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.073781:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c95c3cf/0x51de7f756a83e926 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.073799:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.073802:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.073807:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c95c3cf/0x51de7f756a83e926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.073816:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c95c3cf/0x51de7f756a83e926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.073825:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c95c3cf/0x51de7f756a83e926 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.073833:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c95c3cf/0x51de7f756a83e926 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.073988:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788917053.073994:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c95c3cf/0x51de7f756a83e926 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.074002:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab400 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788917053.074005:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c95c3cf/0x51de7f756a83e926 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.074013:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c95c3cf/0x51de7f756a83e926 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.074026:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c95c3cf/0x51de7f756a83e926 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.074044:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917053.074107:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917053.074110:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917053.074232:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788917053.074237:0:14901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c95c3cf/0x51de7f756a83e926 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788917053.074778:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.074785:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fafe945c/0x51de7f756a83e92d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.074794:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.074797:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.074803:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fafe945c/0x51de7f756a83e92d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.074822:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fafe945c/0x51de7f756a83e92d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.074830:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fafe945c/0x51de7f756a83e92d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.074837:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fafe945c/0x51de7f756a83e92d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.076032:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788917053.076136:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917053.076155:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fafe945c/0x51de7f756a83e92d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.076167:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaba00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917053.076171:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fafe945c/0x51de7f756a83e92d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.076181:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fafe945c/0x51de7f756a83e92d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.076201:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fafe945c/0x51de7f756a83e92d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.076209:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fafe945c/0x51de7f756a83e92d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917053.076237:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917053.076239:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917053.076241:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917053.076584:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917053.076973:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.076980:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e934 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.076990:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.076994:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.077000:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e934 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.077012:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e934 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.077021:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e934 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.077040:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e934 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.077121:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788917053.078368:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917053.078376:0:14901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e93b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.078392:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788917053.078396:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917053.078403:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e93b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.078414:0:14901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e93b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.078424:0:14901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e93b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.078432:0:14901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e93b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917053.078525:0:14901:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:1.0:1788917053.078726:0:14901:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1788917053.078826:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14287:x1875815140780288:12345-0@lo:5:osp-pre-0-0.0 Request processed in 49395us (49584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917053.078840:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788917053.078906:0:14287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14287:1875815140780288:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788917053.078922:0:14287:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788917053.078987:0:14287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14287:1875815140780416:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788917053.079026:0:14287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917053.079186:0:14287:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e2cf27a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788917053.079213:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140780416 00000100:00100000:1.0:1788917053.079222:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140780416 00000100:00100000:1.0:1788917053.079263:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788917053.079271:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14287:x1875815140780416:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788917053.079318:0:14903:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1788917053.079677:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788917053.079685:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e934 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.079695:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeabe00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788917053.079700:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e934 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.079709:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e934 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.079726:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e934 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.079732:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cb2c25f/0x51de7f756a83e934 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.079748:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788917053.079751:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e93b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.079756:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab800 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788917053.079767:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e93b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.079775:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e93b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.079786:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e93b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.079794:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf132c9c/0x51de7f756a83e93b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917053.079807:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917053.079809:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917053.079810:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917053.080199:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917053.087503:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14287:x1875815140780416:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8223us (8468us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788917053.087519:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788917053.089240:0:14287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14287:1875815140780416:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788917053.089259:0:14287:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1788917053.344279:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917054.368297:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917055.391333:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788917055.422364:0:15268:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1788917055.648502:0:14298:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788917055.648514:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917055.648558:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788917055.648564:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1788917056.199342:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788917056.199374:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788917056.415817:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917057.439498:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788917058.079441:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788917058.079448:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788917058.079452:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a6e06d91000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788917058.079462:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 449 00000100:00080000:3.0:1788917058.079470:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788917058.079478:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a6e06d91000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1788917058.079503:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e37134000 x1875815140780800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788917058.079581:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140780800:0@lo:8:kworker.0 00000100:00100000:3.0:1788917058.079660:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917058.079742:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140780928:0@lo:400:kworker.0 00000100:00100000:3.0:1788917058.079786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917058.079822:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788917058.079826:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140780672:0@lo:400:kworker.0 00000100:00100000:3.0:1788917058.079827:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140781056:0@lo:400:kworker.0 00000100:00100000:3.0:1788917058.079850:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917058.079859:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917058.079889:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140780800 00000100:00100000:3.0:1788917058.079897:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140780800 00000100:00100000:0.0:1788917058.079899:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788917058.079915:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140780544:0@lo:400:kworker.0 00000100:00100000:3.0:1788917058.079939:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140780672 00000100:00100000:3.0:1788917058.079942:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140780672 00000100:00100000:0.0:1788917058.079944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917058.079980:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788917058.080036:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140780672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917058.080111:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140780672:12345-0@lo:400:kworker.0 Request processed in 122us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917058.080135:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788917058.080140:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875815140780800:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788917058.080179:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00010000:00020000:0.0:1788917058.080180:0:14900:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788917058.080199:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140780672:0@lo:400:kworker.0 00000100:00100000:2.0:1788917058.080728:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140780544 00000100:00100000:2.0:1788917058.080735:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140780544 00000100:00100000:2.0:1788917058.080780:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788917058.080788:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:3307:x1875815140780544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917058.080833:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:3307:x1875815140780544:12345-0@lo:400:kworker.0 Request processed in 47us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917058.080840:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788917058.081334:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140780544:0@lo:400:kworker.0 00000100:00100000:3.0:1788917058.081436:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788917058.081825:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140781184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788917058.081872:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917058.081969:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140781184 00000100:00100000:1.0:1788917058.081975:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140781184 00000100:00100000:1.0:1788917058.082053:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788917058.082061:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140781184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788917058.082100:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917058.082177:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140781184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917058.082184:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788917058.082674:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140781184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917058.083239:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140780928 00000100:00100000:1.0:1788917058.083245:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140780928 00000100:00100000:1.0:1788917058.083556:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140781056 00000100:00100000:1.0:1788917058.083561:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140781056 00000100:00100000:2.0:1788917058.083729:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788917058.083739:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140780928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917058.083824:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140780928:12345-0@lo:400:kworker.0 Request processed in 86us (4037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917058.083831:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788917058.083850:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788917058.083853:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e37136680 x1875815140780928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788917074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788917058.083856:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140781056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917058.083868:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140780928:0@lo:400:kworker.0 00000100:00100000:2.0:1788917058.083882:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140781056:12345-0@lo:400:kworker.0 Request processed in 27us (4031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917058.083888:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788917058.083889:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e37136a00 x1875815140781056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788917074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788917058.083897:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140781056:0@lo:400:kworker.0 00000100:00080000:1.0:1788917058.085227:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788917058.085239:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917058.096693:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875815140780800:12345-0@lo:8:kworker.0 Request processed in 16538us (17020us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788917058.096712:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788917058.096935:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e06d91000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788917058.096943:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788917058.096947:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140780800:0@lo:8:kworker.0 00010000:00010000:1.0:1788917058.464338:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917059.491325:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788917059.922758:0:15571:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788917059.922762:0:15571:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788917059.923227:0:15571:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a6e1eae5000 00000020:01000004:2.0:1788917059.923244:0:15571:0:(tgt_mount.c:2592:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788917059.923257:0:15571:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788917059.923270:0:15571:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a6e0b5cb380) 00000020:00000080:2.0:1788917059.923286:0:15571:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788917059.939844:0:15571:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788917059.940086:0:15571:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788917059.940830:0:15571:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788917059.941079:0:15571:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788917059.941324:0:15571:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788917059.941634:0:15571:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 677: rc = 0 00100000:10000000:2.0:1788917059.941713:0:15571:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 677: rc = 0 00100000:10000000:2.0:1788917059.941801:0:15571:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 677: rc = 0 00100000:10000000:2.0:1788917059.942285:0:15571:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 773: rc = 0 00100000:10000000:2.0:1788917059.942597:0:15571:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 773: rc = 0 00100000:10000000:2.0:1788917059.942814:0:15571:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 773: rc = 0 00100000:10000000:2.0:1788917059.943060:0:15571:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 773: rc = 0 00100000:10000000:2.0:1788917059.943324:0:15571:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 773: rc = 0 00100000:10000000:2.0:1788917059.943540:0:15571:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 773: rc = 0 00000020:00000080:2.0:1788917059.944060:0:15571:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788917059.944072:0:15571:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788917059.944081:0:15571:0:(genops.c:1407:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x51de7f756a83e949 00000020:01000004:2.0:1788917059.944088:0:15571:0:(tgt_mount.c:2677:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788917059.944109:0:15571:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788917059.944112:0:15571:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788917059.944117:0:15571:0:(tgt_mount.c:1890:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788917059.944137:0:15571:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788917059.944140:0:15571:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788917059.950855:0:15571:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788917059.950904:0:15571:0:(tgt_mount.c:1493:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.140@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788917059.950909:0:15571:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788917059.950911:0:15571:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788917059.950913:0:15571:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788917059.950914:0:15571:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788917059.950915:0:15571:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788917059.950916:0:15571:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788917059.950918:0:15571:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788917059.950919:0:15571:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788917059.950921:0:15571:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788917059.950925:0:15571:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788917059.950927:0:15571:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788917059.950928:0:15571:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788917059.950929:0:15571:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788917059.950931:0:15571:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788917059.950932:0:15571:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788917059.950933:0:15571:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788917059.950934:0:15571:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788917059.950935:0:15571:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788917059.950941:0:15571:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788917059.950966:0:15571:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788917059.950986:0:15571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140781312:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788917059.951065:0:15571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917059.951187:0:15571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06016540 going to sleep for 11 seconds 00000100:00100000:1.0:1788917059.951246:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140781312 00000100:00100000:1.0:1788917059.951253:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140781312 00000100:00100000:1.0:1788917059.951308:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788917059.951316:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:15571:x1875815140781312:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788917059.951342:0:14257:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788917059.951345:0:14257:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788917059.951348:0:14257:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788917059.956399:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:15571:x1875815140781312:12345-0@lo:253:mount.lustre.0 Request processed in 5074us (5324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917059.956427:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788917059.956434:0:15571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140781312:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788917059.956449:0:15571:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788917059.956453:0:15571:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788917059.956455:0:15571:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788917059.956456:0:15571:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788917059.956457:0:15571:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788917059.956458:0:15571:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788917059.956459:0:15571:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788917059.956460:0:15571:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788917059.956462:0:15571:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788917059.956464:0:15571:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788917059.956483:0:15571:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a6e1eae5000 from lustre-OST0001 10000000:01000000:2.0:1788917059.956522:0:15571:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788917059.956525:0:15571:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788917059.956534:0:15571:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a6e2cd0cd40 local copy 00010000:00010000:2.0:1788917059.956545:0:15571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83e6ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e6f6 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917059.956820:0:15571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140781440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788917059.956851:0:15571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917059.956894:0:15571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e060160c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788917059.956915:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140781440 00000100:00100000:1.0:1788917059.956921:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140781440 00000100:00100000:1.0:1788917059.956958:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788917059.956967:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:15571:x1875815140781440:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788917059.957243:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:15571:x1875815140781440:12345-0@lo:501:mount.lustre.0 Request processed in 276us (389us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788917059.957252:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788917059.957285:0:15571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140781440:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788917059.957298:0:15571:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788917059.957613:0:15571:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788917059.957620:0:15571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83e6ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e6f6 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917059.957627:0:15571:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ec00/0x51de7f756a83e6ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e6f6 expref: -99 pid: 14247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788917059.957646:0:15571:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a6e1eae5000 10000000:01000000:3.0:1788917059.957649:0:15571:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788917059.957652:0:15571:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788917059.957654:0:15571:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788917059.957657:0:15571:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788917059.957659:0:15571:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788917059.957678:0:15571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ee00/0x51de7f756a83e950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917059.957685:0:15571:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ee00/0x51de7f756a83e950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917059.957701:0:15571:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ee00/0x51de7f756a83e950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917059.957715:0:15571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140781568:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788917059.957752:0:15571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917059.957786:0:15571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e39c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788917059.957830:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140781568 00000100:00100000:1.0:1788917059.957834:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140781568 00000100:00100000:1.0:1788917059.957863:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788917059.957870:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:15571:x1875815140781568:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788917059.957880:0:14257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788917059.957911:0:14257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e1eeaae00/0x51de7f756a83e957 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83e950 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917059.957941:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e1eeaae00/0x51de7f756a83e957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83e950 expref: 17 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917059.957951:0:14257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e1eeaae00/0x51de7f756a83e957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e950 expref: 17 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917059.957960:0:14257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeaae00, rc 0) 00000100:00100000:1.0:1788917059.958039:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:15571:x1875815140781568:12345-0@lo:101:mount.lustre.0 Request processed in 169us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917059.958046:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788917059.958095:0:15571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140781568:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788917059.958107:0:15571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ee00/0x51de7f756a83e950 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e957 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917059.958123:0:15571:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ee00/0x51de7f756a83e950 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83e957 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788917059.958943:0:15571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788917059.960022:0:15571:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788917059.960399:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788917059.960441:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788917059.960469:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788917059.960691:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788917059.960730:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788917059.960767:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788917059.960834:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788917059.960843:0:15571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788917059.960946:0:15571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140781696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788917059.961017:0:15571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917059.961109:0:15571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e39900 going to sleep for 11 seconds 00000100:00100000:1.0:1788917059.961222:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140781696 00000100:00100000:1.0:1788917059.961230:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140781696 00000100:00100000:1.0:1788917059.961284:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788917059.961293:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:15571:x1875815140781696:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788917059.961957:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:15571:x1875815140781696:12345-0@lo:501:mount.lustre.0 Request processed in 664us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917059.961966:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788917059.962039:0:15571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140781696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788917059.962073:0:15571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140781824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788917059.962113:0:15571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917059.962214:0:15571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e39900 going to sleep for 11 seconds 00000100:00100000:1.0:1788917059.962277:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140781824 00000100:00100000:1.0:1788917059.962282:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140781824 00000100:00100000:1.0:1788917059.962314:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788917059.962320:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:15571:x1875815140781824:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788917059.962770:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:15571:x1875815140781824:12345-0@lo:503:mount.lustre.0 Request processed in 449us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917059.962777:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788917059.962844:0:15571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140781824:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788917059.963367:0:15571:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788917059.963431:0:15571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140781952:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788917059.963469:0:15571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917059.963653:0:15571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e39900 going to sleep for 11 seconds 00000100:00100000:1.0:1788917059.963688:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140781952 00000100:00100000:1.0:1788917059.963694:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140781952 00000100:00100000:1.0:1788917059.963731:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788917059.963738:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:15571:x1875815140781952:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788917059.963945:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:15571:x1875815140781952:12345-0@lo:502:mount.lustre.0 Request processed in 207us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917059.963952:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788917059.964010:0:15571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140781952:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788917059.964297:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788917059.964343:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788917059.964376:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788917059.964417:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788917059.964449:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788917059.964476:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788917059.964648:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788917059.964685:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788917059.964734:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788917059.964758:0:15571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140782080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788917059.964793:0:15571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917059.964856:0:15571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e39900 going to sleep for 11 seconds 00000100:00100000:1.0:1788917059.964896:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140782080 00000100:00100000:1.0:1788917059.964901:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140782080 00000100:00100000:1.0:1788917059.964936:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788917059.964943:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:15571:x1875815140782080:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788917059.965193:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:15571:x1875815140782080:12345-0@lo:502:mount.lustre.0 Request processed in 250us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917059.965201:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788917059.965285:0:15571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140782080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788917059.965340:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788917059.965349:0:15571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788917059.966304:0:15572:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788917059.966313:0:15572:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788917059.966319:0:15572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788917059.966322:0:15572:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788917059.966340:0:15572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788917059.966361:0:15572:0:(genops.c:414:class_newdev()) Allocate new device lustre-OST0001 (ffff9a6d02b719c0) 00000020:00000080:0.0:1788917059.966383:0:15572:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788917059.966390:0:15572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788917059.966457:0:15572:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6e1eae5000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788917059.966465:0:15572:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788917059.966472:0:15572:0:(genops.c:1407:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x51de7f756a83e965 00010000:00010000:0.0:1788917059.970431:0:15572:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1788917059.971061:0:15572:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788917059.973142:0:15572:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788917059.974621:0:15572:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788917059.974633:0:15572:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788917059.974639:0:15572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788917059.974641:0:15572:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788917059.974644:0:15572:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788917059.974647:0:15572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788917059.974649:0:15572:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788917059.974651:0:15572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788917059.974653:0:15572:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788917059.974655:0:15572:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788917059.974657:0:15572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788917059.974658:0:15572:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788917059.974661:0:15572:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788917059.974662:0:15572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788917059.974663:0:15572:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788917059.974666:0:15572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788917059.974714:0:15572:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788917059.974724:0:15572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788917059.974726:0:15572:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788917059.974730:0:15572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788917059.974953:0:15571:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788917059.974984:0:15571:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788917059.975007:0:15571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ee00/0x51de7f756a83e950 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e957 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917059.975018:0:15571:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18ee00/0x51de7f756a83e950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e957 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788917059.975027:0:15571:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e1eae5000 from 1 10000000:01000000:3.0:1788917059.975030:0:15571:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788917059.975066:0:15571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83e96c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917059.975075:0:15571:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83e96c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917059.975093:0:15571:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83e96c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917059.975120:0:15571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140782208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788917059.975219:0:15571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917059.975258:0:15571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e39900 going to sleep for 11 seconds 00000100:00100000:1.0:1788917059.975441:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140782208 00000100:00100000:1.0:1788917059.975449:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140782208 00000100:00100000:1.0:1788917059.975631:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788917059.975642:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:15571:x1875815140782208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788917059.975656:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788917059.975670:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e1eeaac00/0x51de7f756a83e973 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83e96c expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917059.975694:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e1eeaac00/0x51de7f756a83e973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83e96c expref: 18 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917059.975704:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e1eeaac00/0x51de7f756a83e973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e96c expref: 18 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917059.975713:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1eeaac00, rc 0) 00000100:00100000:1.0:1788917059.975761:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:15571:x1875815140782208:12345-0@lo:101:mount.lustre.0 Request processed in 121us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917059.975768:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788917059.975903:0:15571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140782208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788917059.975918:0:15571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83e96c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e973 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917059.975928:0:15571:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83e96c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83e973 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788917059.976909:0:15571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788917059.977230:0:15571:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788917059.977454:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788917059.977508:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788917059.979354:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788917059.979373:0:15571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788917059.979606:0:15571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140782336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788917059.979689:0:15571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917059.979779:0:15571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e39900 going to sleep for 11 seconds 00000100:00100000:1.0:1788917059.983630:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140782336 00000100:00100000:1.0:1788917059.983650:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140782336 00000100:00100000:1.0:1788917059.983704:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788917059.983715:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:15571:x1875815140782336:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788917059.984958:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:15571:x1875815140782336:12345-0@lo:501:mount.lustre.0 Request processed in 1239us (5263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917059.984971:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788917059.986941:0:15571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140782336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788917059.987007:0:15571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140782464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788917059.987090:0:15571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917059.987134:0:15571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e364366c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788917059.987220:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140782464 00000100:00100000:2.0:1788917059.987227:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140782464 00000100:00100000:2.0:1788917059.987279:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788917059.987296:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:15571:x1875815140782464:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788917059.987810:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:15571:x1875815140782464:12345-0@lo:503:mount.lustre.0 Request processed in 514us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917059.987819:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788917059.987929:0:15571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140782464:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788917059.988536:0:15571:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788917059.988613:0:15571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140782592:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788917059.988659:0:15571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917059.988683:0:15571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e364366c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788917059.988847:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140782592 00000100:00100000:2.0:1788917059.988853:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140782592 00000100:00100000:2.0:1788917059.988908:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788917059.988917:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:15571:x1875815140782592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788917059.989098:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:15571:x1875815140782592:12345-0@lo:502:mount.lustre.0 Request processed in 182us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917059.989105:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788917059.989279:0:15571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140782592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788917059.989627:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788917059.989668:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788917059.989720:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788917059.989757:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788917059.989791:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788917059.989854:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788917059.989908:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788917059.989946:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788917059.989974:0:15571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140782720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788917059.990021:0:15571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917059.990045:0:15571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e364366c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788917059.990103:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140782720 00000100:00100000:2.0:1788917059.990108:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140782720 00000100:00100000:2.0:1788917059.990172:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788917059.990181:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:15571:x1875815140782720:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788917059.990322:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:15571:x1875815140782720:12345-0@lo:502:mount.lustre.0 Request processed in 142us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917059.990329:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788917059.990466:0:15571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140782720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788917059.990676:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788917059.990686:0:15571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788917059.991491:0:15576:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788917059.991507:0:15576:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788917059.991509:0:15576:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788917059.991516:0:15576:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6e1eae5000 00000020:00000080:1.0:1788917059.991519:0:15576:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788917059.991527:0:15576:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788917059.991529:0:15576:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788917059.991530:0:15576:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788917059.991533:0:15576:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788917059.991535:0:15576:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788917059.991536:0:15576:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788917059.991539:0:15576:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6e1eae5000 00000020:00000080:1.0:1788917059.991541:0:15576:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788917059.991646:0:15576:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788917059.991650:0:15576:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788917059.991651:0:15576:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788917059.991654:0:15576:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788917059.991657:0:15576:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788917059.991658:0:15576:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788917059.991662:0:15576:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a6e1eae5000 00000020:00000080:1.0:1788917059.991664:0:15576:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788917059.995127:0:15576:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788917059.995139:0:15576:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788917059.995141:0:15576:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788917059.995183:0:15576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788917059.996974:0:15571:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788917059.997009:0:15571:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788917059.997036:0:15571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83e96c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e973 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917059.997049:0:15571:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83e96c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e973 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788917059.997101:0:15571:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788917059.997105:0:15571:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a6e1eae5000 10000000:01000000:0.0:1788917059.997108:0:15571:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a6e1eae5000 10000000:01000000:0.0:1788917059.997112:0:15571:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788917059.997118:0:15571:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a6e1eae5000 from 1 10000000:01000000:0.0:1788917059.997121:0:15571:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788917059.997175:0:15571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e97a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917059.997183:0:15571:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e97a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917059.997195:0:15571:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e97a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917059.997221:0:15571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140782848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788917059.997301:0:15571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917059.997339:0:15571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e04cb5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788917059.997363:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140782848 00000100:00100000:0.0:1788917059.997371:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140782848 00000100:00100000:0.0:1788917059.997449:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788917059.997459:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:15571:x1875815140782848:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788917059.997474:0:14258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917059.997487:0:14258:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee3e00/0x51de7f756a83e981 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83e97a expref: -99 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917059.997511:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee3e00/0x51de7f756a83e981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83e97a expref: 19 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917059.997522:0:14258:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee3e00/0x51de7f756a83e981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e97a expref: 19 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917059.997530:0:14258:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3e00, rc 0) 00000100:00100000:0.0:1788917059.997582:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:15571:x1875815140782848:12345-0@lo:101:mount.lustre.0 Request processed in 124us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917059.997589:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788917059.997625:0:15571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140782848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788917059.997642:0:15571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e97a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e981 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917059.997652:0:15571:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e97a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83e981 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788917059.998687:0:15571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788917059.999455:0:15571:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788917059.999938:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788917060.000018:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788917060.000104:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788917060.000227:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788917060.000323:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788917060.000409:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788917060.000878:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788917060.000947:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788917060.001033:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788917060.001092:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788917060.001221:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788917060.001306:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788917060.001368:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788917060.001428:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788917060.001520:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788917060.001591:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788917060.001665:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788917060.001765:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788917060.001828:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788917060.001904:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788917060.001989:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788917060.002034:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788917060.002079:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788917060.002230:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788917060.002286:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788917060.002342:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788917060.002440:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788917060.002480:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788917060.002523:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788917060.002584:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788917060.002623:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788917060.002683:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788917060.002741:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788917060.002809:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788917060.002874:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788917060.003469:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788917060.003541:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788917060.003675:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788917060.003689:0:15571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788917060.003801:0:15571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140782976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788917060.003893:0:15571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917060.003941:0:15571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e28dbf600 going to sleep for 11 seconds 00000100:00100000:3.0:1788917060.004015:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140782976 00000100:00100000:3.0:1788917060.004025:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140782976 00000100:00100000:3.0:1788917060.004075:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788917060.004085:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:15571:x1875815140782976:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788917060.004354:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:15571:x1875815140782976:12345-0@lo:501:mount.lustre.0 Request processed in 269us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917060.004368:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788917060.004392:0:15571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140782976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788917060.004437:0:15571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140783104:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788917060.004481:0:15571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917060.004511:0:15571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e04cb5180 going to sleep for 11 seconds 00000100:00100000:3.0:1788917060.004542:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140783104 00000100:00100000:3.0:1788917060.004546:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140783104 00000100:00100000:3.0:1788917060.004574:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788917060.004582:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:15571:x1875815140783104:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788917060.005576:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:15571:x1875815140783104:12345-0@lo:503:mount.lustre.0 Request processed in 992us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917060.005580:0:15571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140783104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788917060.005583:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000040:00080000:0.0:1788917060.006507:0:15571:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788917060.006577:0:15571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140783232:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788917060.006625:0:15571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917060.006701:0:15571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e04cb5180 going to sleep for 11 seconds 00000100:00100000:3.0:1788917060.006736:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140783232 00000100:00100000:3.0:1788917060.006742:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140783232 00000100:00100000:3.0:1788917060.006804:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788917060.006812:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:15571:x1875815140783232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788917060.007064:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:15571:x1875815140783232:12345-0@lo:502:mount.lustre.0 Request processed in 253us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917060.007071:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788917060.007129:0:15571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140783232:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788917060.007353:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788917060.007393:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788917060.007420:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788917060.007465:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788917060.007503:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788917060.007548:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788917060.007579:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788917060.007608:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788917060.007662:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788917060.007695:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788917060.007720:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788917060.007766:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788917060.007798:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788917060.007827:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788917060.007867:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788917060.007913:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788917060.007958:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788917060.008004:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788917060.008041:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788917060.008075:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788917060.008118:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788917060.008174:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788917060.008206:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788917060.008247:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788917060.008277:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788917060.008303:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788917060.008344:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788917060.008373:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788917060.008411:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788917060.008456:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788917060.008493:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788917060.008528:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788917060.008573:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788917060.008710:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788917060.008778:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788917060.008831:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788917060.008868:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788917060.008914:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788917060.008959:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788917060.008992:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788917060.009025:0:15571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140783360:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788917060.009080:0:15571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917060.009135:0:15571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e04cb5180 going to sleep for 11 seconds 00000100:00100000:3.0:1788917060.009216:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140783360 00000100:00100000:3.0:1788917060.009222:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140783360 00000100:00100000:3.0:1788917060.009279:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788917060.009285:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:15571:x1875815140783360:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788917060.009433:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:15571:x1875815140783360:12345-0@lo:502:mount.lustre.0 Request processed in 147us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917060.009440:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788917060.009507:0:15571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140783360:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788917060.009559:0:15571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788917060.009567:0:15571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788917060.010379:0:15581:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788917060.010396:0:15581:0:(genops.c:414:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a6e0a7399c0) 00000020:00000080:1.0:1788917060.010427:0:15581:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788917060.010603:0:15581:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6e1eae5000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788917060.010607:0:15581:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6e1eae5000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788917060.010612:0:15581:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6e1eae5000 3 00010000:00080000:1.0:1788917060.010634:0:15581:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6e1eaf3000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1788917060.011991:0:15581:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788917060.012064:0:15581:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788917060.012088:0:15581:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788917060.012098:0:15581:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x51de7f756a83e98f 00000100:00080000:1.0:1788917060.012107:0:15581:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788917060.012112:0:15581:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a6e1eaf3000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1788917060.012179:0:15581:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e3a681500 x1875815140783488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788917060.012206:0:15581:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788917060.012271:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788917060.012275:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788917060.012278:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a6e06d91000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788917060.012283:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 454 00000100:00080000:0.0:1788917060.012286:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788917060.012291:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a6e06d91000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1788917060.012304:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e3fcb8380 x1875815140783744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788917060.012352:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140783616:0@lo:400:kworker.0 00000100:00100000:0.0:1788917060.012352:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875815140784000:0@lo:400:kworker.0 00000100:00100000:3.0:1788917060.012400:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875815140783488:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788917060.012462:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917060.012497:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788917060.012503:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140783872:0@lo:400:kworker.0 00000100:00100000:0.0:1788917060.012525:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917060.014272:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917060.014362:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140784000 00000100:00100000:1.0:1788917060.014371:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140784000 00000100:00100000:1.0:1788917060.014432:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140783872 00000100:00100000:1.0:1788917060.014436:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140783872 00000100:00100000:1.0:1788917060.014453:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788917060.014460:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875815140784000:12345-0@lo:400:kworker.0 00000040:00080000:0.0:1788917060.014475:0:15581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1788917060.014517:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875815140784000:12345-0@lo:400:kworker.0 Request processed in 56us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917060.014523:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788917060.014536:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788917060.014542:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140783872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917060.014568:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140783872:12345-0@lo:400:kworker.0 Request processed in 27us (2042us total) trans 0 rc 0/0 00000020:01000000:0.0:1788917060.014572:0:15571:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00000100:00100000:1.0:1788917060.014574:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 10000000:01000000:0.0:1788917060.014601:0:15571:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00080000:1.0:1788917060.014612:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788917060.014617:0:15571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e97a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e981 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917060.014627:0:15571:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee2c00/0x51de7f756a83e97a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e981 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788917060.014642:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e3fcb9500 x1875815140783872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788917076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788917060.014656:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140783872:0@lo:400:kworker.0 00010000:00080000:1.0:1788917060.014668:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e3fcbad80 x1875815140784000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788917076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788917060.014676:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875815140784000:0@lo:400:kworker.0 00000020:01000004:0.0:1788917060.014681:0:15571:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788917060.014683:0:15571:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788917060.014684:0:15571:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788917060.014686:0:15571:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788917060.014687:0:15571:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788917060.014688:0:15571:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788917060.014690:0:15571:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788917060.014691:0:15571:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788917060.014693:0:15571:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788917060.014696:0:15571:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788917060.014699:0:15571:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788917060.014700:0:15571:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788917060.014702:0:15571:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788917060.014703:0:15571:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788917060.014704:0:15571:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788917060.014705:0:15571:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788917060.014706:0:15571:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788917060.014708:0:15571:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788917060.014708:0:15571:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788917060.014727:0:15571:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788917060.014742:0:15571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140784128:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788917060.014776:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140783616 00000100:00100000:2.0:1788917060.014780:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140783616 00000100:00100000:0.0:1788917060.014788:0:15571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917060.014813:0:15571:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e04cb5840 going to sleep for 11 seconds 00000100:00100000:2.0:1788917060.014817:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788917060.014824:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140783616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917060.014865:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140783616:12345-0@lo:400:kworker.0 Request processed in 42us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917060.014871:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788917060.014964:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917060.014989:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140783616:0@lo:400:kworker.0 00000100:00100000:2.0:1788917060.015414:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140784128 00000100:00100000:2.0:1788917060.015486:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140784128 00000100:00100000:2.0:1788917060.015525:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788917060.015532:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:15571:x1875815140784128:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788917060.015554:0:14259:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788917060.015568:0:14259:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788917060.016493:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917060.016534:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140783744:0@lo:8:kworker.0 00000100:00100000:3.0:1788917060.016568:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917060.016590:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140783744 00000100:00100000:3.0:1788917060.016594:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140783744 00000100:00100000:3.0:1788917060.016617:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788917060.016622:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875815140783744:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788917060.016665:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875815140783744:12345-0@lo:8:kworker.0 Request processed in 42us (96us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788917060.016672:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788917060.016700:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788917060.016706:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e06d91000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788917060.016711:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788917060.016714:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140783744:0@lo:8:kworker.0 00000100:00100000:0.0:1788917060.016764:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140783488 00000100:00100000:0.0:1788917060.016769:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140783488 00000100:00100000:0.0:1788917060.016826:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788917060.016837:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875815140783488:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788917060.016852:0:14264:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:0.0:1788917060.016904:0:14264:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x51de7f756a83e996 00000004:00100000:0.0:1788917060.016920:0:14264:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788917060.016948:0:14264:0:(import.c:65:import_set_state_nolock()) ffff9a6e1eae4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788917060.017007:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875815140783488:12345-0@lo:38:llog_process_th.0 Request processed in 169us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917060.017013:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788917060.017118:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6e3a681500 x1875815140783488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788917070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788917060.017127:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788917060.017133:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788917060.017140:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788917060.017163:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788917060.017166:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e1eaf3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788917060.017171:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875815140783488:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1788917060.026022:0:14259:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788917060.026042:0:14259:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788917060.026300:0:14280:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788917060.026306:0:14280:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788917060.026331:0:14280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e99d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917060.026350:0:14280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e2d18f800/0x51de7f756a83e870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e869 expref: 19 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917060.026374:0:14280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e99d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917060.026430:0:14280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e2d18f800/0x51de7f756a83e870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83e869 expref: 19 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917060.026444:0:14280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6e2d18f800/0x51de7f756a83e870 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83e869 expref: 19 pid: 14258 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917060.026460:0:14280:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14280:1875815140784256:0@lo:104: 00000100:00100000:2.0:1788917060.026534:0:14280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917060.026585:0:14280:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e032f3300 going to sleep for 11 seconds 00000100:00100000:1.0:1788917060.027312:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140784256 00000100:00100000:1.0:1788917060.027321:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140784256 00000100:00100000:1.0:1788917060.027376:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788917060.027386:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+3:14280:x1875815140784256:12345-0@lo:104: 00010000:00010000:1.0:1788917060.027399:0:14249:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83e869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83e870 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917060.027470:0:14249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788917060.027478:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+3:14280:x1875815140784256:12345-0@lo:104: Request processed in 92us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917060.027486:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788917060.027494:0:14280:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14280:1875815140784256:0@lo:104: 00010000:00010000:3.0:1788917060.027505:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917060.027514:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83e869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83e870 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917060.027521:0:14280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e99d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917060.027535:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031600 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1788917060.027542:0:14253:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83e869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83e870 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917060.027560:0:14253:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83e869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83e870 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788917060.027568:0:14253:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83e869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83e870 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788917060.027575:0:14253:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788917060.027610:0:14253:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83e869 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e870 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917060.027617:0:14253:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788917060.027648:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83e869 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e870 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917060.027656:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83e869 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e870 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917060.027658:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140784384:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788917060.027675:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917060.027677:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917060.027679:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917060.027691:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917060.027832:0:14252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140784384 00000100:00100000:3.0:1788917060.027836:0:14252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140784384 00010000:00010000:3.0:1788917060.027857:0:14252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e2d18f800/0x51de7f756a83e870 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83e869 expref: 20 pid: 14258 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917060.027899:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788917060.027907:0:14252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a682a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+20:3306:x1875815140784384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788917060.027917:0:14252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917060.027923:0:14252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e2d18f800/0x51de7f756a83e870 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83e869 expref: 20 pid: 14258 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917060.027939:0:14252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e2d18f800/0x51de7f756a83e870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83e869 expref: 20 pid: 14258 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917060.027953:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e2d18f800/0x51de7f756a83e870 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83e869 expref: 20 pid: 14258 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917060.027967:0:14252:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e99d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917060.027975:0:14252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e99d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788917060.027987:0:14252:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002008517s 00010000:00010000:3.0:1788917060.027991:0:14252:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e99d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917060.027999:0:14252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e99d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917060.028004:0:14252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e99d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917060.028009:0:14252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e99d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917060.028012:0:14252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e00031200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917060.028015:0:14252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e99d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917060.028020:0:14252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e99d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917060.028048:0:14252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e99d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917060.028058:0:14252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788917060.028163:0:14280:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e99d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917060.028171:0:14280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e99d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917060.028178:0:14280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e00031200/0x51de7f756a83e99d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917060.028232:0:14252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a682a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140784384:12345-0@lo:103:ldlm_bl.0 Request processed in 326us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917060.028239:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788917060.028301:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37135180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140784384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788917060.032572:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:15571:x1875815140784128:12345-0@lo:253:mount.lustre.0 Request processed in 17030us (17772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917060.032585:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788917060.032604:0:15571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:15571:1875815140784128:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788917060.032625:0:15571:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788917060.032629:0:15571:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788917060.032631:0:15571:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788917060.032634:0:15571:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788917060.032635:0:15571:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788917060.032637:0:15571:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788917060.032639:0:15571:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788917060.032640:0:15571:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788917060.032642:0:15571:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788917060.032644:0:15571:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788917060.032670:0:15571:0:(tgt_mount.c:2781:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788917060.036238:0:15571:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788917060.036356:0:15571:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788917060.036491:0:15571:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788917060.036637:0:15571:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788917060.036766:0:15571:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788917060.036932:0:15571:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788917060.037732:0:15571:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788917060.082901:0:15571:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788917060.082911:0:15571:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788917060.082946:0:15571:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788917060.083015:0:15571:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788917060.083030:0:15571:0:(tgt_mount.c:2550:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788917060.083059:0:15571:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788917060.511623:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917061.542274:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788917061.855233:0:14262:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788917061.855252:0:14262:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a6e05362800 from 8 10000000:01000000:0.0:1788917061.855257:0:14262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788917061.855309:0:14262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3400/0x51de7f756a83e9a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917061.855320:0:14262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3400/0x51de7f756a83e9a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917061.855331:0:14262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3400/0x51de7f756a83e9a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917061.855368:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140784512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788917061.855462:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917061.855516:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b16b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788917061.855622:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140784512 00000100:00100000:3.0:1788917061.855631:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140784512 00000100:00100000:3.0:1788917061.855697:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788917061.855709:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:14262:x1875815140784512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788917061.855727:0:14258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917061.855743:0:14258:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e2d18e400/0x51de7f756a83e9ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83e9a4 expref: -99 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917061.855767:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e2d18e400/0x51de7f756a83e9ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83e9a4 expref: 19 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917061.855783:0:14258:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e2d18e400/0x51de7f756a83e9ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e9a4 expref: 19 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917061.855794:0:14258:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e400, rc 0) 00000100:00100000:3.0:1788917061.855905:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:14262:x1875815140784512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917061.855912:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788917061.856033:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140784512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788917061.856049:0:14262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3400/0x51de7f756a83e9a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e9ab expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917061.856058:0:14262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3400/0x51de7f756a83e9a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83e9ab expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917061.856109:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140784640:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788917061.856208:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917061.856237:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b16b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788917061.856310:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140784640 00000100:00100000:1.0:1788917061.856322:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140784640 00000100:00100000:1.0:1788917061.856362:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788917061.856370:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:14262:x1875815140784640:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788917061.856387:0:14259:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788917061.856407:0:14259:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788917061.856411:0:14259:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788917061.856508:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:14262:x1875815140784640:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917061.856515:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788917061.856525:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140784640:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788917061.856598:0:14262:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788917061.856606:0:14262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3400/0x51de7f756a83e9a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e9ab expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917061.856624:0:14262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e06ee3400/0x51de7f756a83e9a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83e9ab expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917062.560702:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917063.199860:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788917063.199889:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140784768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917063.199970:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917063.200062:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140784768 00000100:00100000:1.0:1788917063.200071:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140784768 00000100:00100000:1.0:1788917063.200139:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788917063.200178:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140784768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788917063.200225:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917063.200277:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140784768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917063.200288:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788917063.200315:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917063.200357:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140784768:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788917063.585817:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788917064.163855:0:15924:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788917064.608921:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788917065.248753:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788917065.248760:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788917065.248765:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a6e06d91000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788917065.248775:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140785024:0@lo:400:kworker.0 00000100:00080000:2.0:1788917065.248777:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a6e06d91000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1788917065.248807:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6e28d63b80 x1875815140785152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788917065.248896:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140784896:0@lo:400:kworker.0 00000100:00100000:3.0:1788917065.248908:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140785152:0@lo:8:kworker.0 00000100:00100000:0.0:1788917065.248928:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917065.248945:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917065.248954:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917065.249096:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140785024 00000100:00100000:1.0:1788917065.249104:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140785024 00000100:00100000:1.0:1788917065.249354:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140785152 00000100:00100000:1.0:1788917065.249363:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140785152 00000100:00100000:1.0:1788917065.249379:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788917065.249388:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140785024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917065.249451:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140785024:12345-0@lo:400:kworker.0 Request processed in 64us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917065.249459:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788917065.249476:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788917065.249480:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3303:x1875815140785152:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788917065.249503:0:14903:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:1.0:1788917065.249531:0:14903:0:(genops.c:1407:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x51de7f756a83e9b2 00002000:00100000:1.0:1788917065.249554:0:14903:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a6e3f2a7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211371a ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788917065.249559:0:14903:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788917065.249563:0:14903:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788917065.249940:0:14903:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788917065.249967:0:14903:0:(import.c:65:import_set_state_nolock()) ffff9a6e3f2a1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788917065.250009:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1875815140785152:12345-0@lo:8:kworker.0 Request processed in 527us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917065.250017:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788917065.250108:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917065.250173:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140785024:0@lo:400:kworker.0 00000100:00100000:2.0:1788917065.250611:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140785280:0@lo:400:kworker.0 00000100:00100000:2.0:1788917065.250654:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917065.250784:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140785408:0@lo:400:kworker.0 00000100:00100000:2.0:1788917065.250817:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788917065.250912:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e28d63b80 x1875815140785152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788917090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788917065.250920:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788917065.250926:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140785536:0@lo:400:kworker.0 00000100:00080000:3.0:1788917065.250927:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788917065.250936:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788917065.250942:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788917065.250944:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a6e06d91000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788917065.250954:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788917065.250961:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788917065.250966:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875815140785152:0@lo:8:kworker.0 00000100:00100000:1.0:1788917065.250977:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140785280 00000100:00100000:1.0:1788917065.250983:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140785280 00000100:00100000:3.0:1788917065.250990:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140784896 00000100:00100000:3.0:1788917065.250993:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140784896 00000100:00100000:1.0:1788917065.251016:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140785408 00000100:00100000:1.0:1788917065.251018:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140785408 00000100:00100000:3.0:1788917065.251022:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788917065.251030:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140784896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917065.251042:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788917065.251048:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140785280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917065.251070:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140784896:12345-0@lo:400:kworker.0 Request processed in 42us (2126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917065.251078:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788917065.251085:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140785280:12345-0@lo:400:kworker.0 Request processed in 39us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917065.251097:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788917065.251113:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788917065.251120:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140785408:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1788917065.251139:0:14289:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788917065.251173:0:14289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37135180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14289:1875815140785792:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788917065.251177:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140785408:12345-0@lo:400:kworker.0 Request processed in 59us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917065.251184:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788917065.251198:0:14289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788917065.251203:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917065.251215:0:14289:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e28d65240 going to sleep for 11 seconds 00000040:00080000:3.0:1788917065.251248:0:14288:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 9 count 2 00000100:00100000:2.0:1788917065.251282:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140785664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788917065.251311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917065.251343:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140785664 00000100:00100000:2.0:1788917065.251346:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140785664 00000100:00100000:2.0:1788917065.251382:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788917065.251389:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140785664:12345-0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788917065.251411:0:14288:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00002000:00000024:2.0:1788917065.251414:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000040:00080000:3.0:1788917065.251420:0:14288:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1788917065.251455:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140785664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917065.251466:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788917065.251493:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140785920:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788917065.251515:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788917065.251540:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e28d62300 x1875815140785280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788917081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788917065.251551:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140785280:0@lo:400:kworker.0 00000100:00080000:2.0:1788917065.251567:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788917065.251570:0:14288:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:2.0:1788917065.251583:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e28d62680 x1875815140785408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788917081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788917065.251592:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140785408:0@lo:400:kworker.0 00000100:00100000:2.0:1788917065.251610:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140784896:0@lo:400:kworker.0 00010000:00080000:2.0:1788917065.251757:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e37135500 x1875815140785664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788917081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788917065.251771:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140785664:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1788917065.252640:0:14288:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 461284492878ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788917065.252680:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140785536 00000100:00100000:3.0:1788917065.252686:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140785536 00000100:00100000:2.0:1788917065.252712:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140785792 00000100:00100000:2.0:1788917065.252716:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140785792 00000100:00100000:3.0:1788917065.252723:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788917065.252730:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140785536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917065.252734:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140785920 00000100:00100000:2.0:1788917065.252736:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140785920 00000100:00100000:2.0:1788917065.252747:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788917065.252752:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14289:x1875815140785792:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1788917065.254214:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917065.254285:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140785536:12345-0@lo:400:kworker.0 Request processed in 1552us (3326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917065.254295:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788917065.254359:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6e28d62d80 x1875815140785536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788917081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788917065.254374:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140785536:0@lo:400:kworker.0 00002000:00080000:1.0:1788917065.263194:0:14903:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788917065.263205:0:14903:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788917065.263211:0:14903:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1788917065.273094:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.273112:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.273136:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.273142:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.273207:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.273230:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.273244:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.273252:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.273504:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788917065.273520:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788917065.273528:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.273540:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaa000 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788917065.273547:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.273557:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.273580:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.273587:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.273611:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917065.273613:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917065.273615:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917065.275787:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.275801:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.275821:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.275845:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.275854:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.275869:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.275880:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.275888:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.275912:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788917065.275927:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788917065.275932:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.275940:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaa400 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788917065.275947:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.275956:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.275977:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.275997:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.276027:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917065.276029:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917065.276031:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917065.276698:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.276706:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000539764df/0x51de7f756a83e9c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.276716:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.276721:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.276726:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000539764df/0x51de7f756a83e9c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.276737:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000539764df/0x51de7f756a83e9c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.276746:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000539764df/0x51de7f756a83e9c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.276754:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000539764df/0x51de7f756a83e9c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.276773:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788917065.276784:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788917065.276796:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000539764df/0x51de7f756a83e9c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.276804:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaa200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788917065.276809:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000539764df/0x51de7f756a83e9c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.276817:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000539764df/0x51de7f756a83e9c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.276829:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000539764df/0x51de7f756a83e9c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.276852:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000539764df/0x51de7f756a83e9c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.276869:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917065.276871:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917065.276873:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917065.277419:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.277427:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1f94da/0x51de7f756a83e9ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.277438:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.277441:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.277447:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f1f94da/0x51de7f756a83e9ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.277470:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f1f94da/0x51de7f756a83e9ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.277479:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1f94da/0x51de7f756a83e9ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.277487:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f1f94da/0x51de7f756a83e9ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.277503:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788917065.277514:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788917065.277519:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f1f94da/0x51de7f756a83e9ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.277526:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaa800 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788917065.277531:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1f94da/0x51de7f756a83e9ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.277540:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1f94da/0x51de7f756a83e9ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.277551:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f1f94da/0x51de7f756a83e9ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.277559:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f1f94da/0x51de7f756a83e9ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.277582:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917065.277584:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917065.277585:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917065.278097:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.278104:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e30d5f1/0x51de7f756a83e9d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.278115:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.278119:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.278125:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e30d5f1/0x51de7f756a83e9d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.278136:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e30d5f1/0x51de7f756a83e9d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.278169:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e30d5f1/0x51de7f756a83e9d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.278178:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e30d5f1/0x51de7f756a83e9d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.278197:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788917065.278207:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788917065.278211:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e30d5f1/0x51de7f756a83e9d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.278231:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab000 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788917065.278236:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e30d5f1/0x51de7f756a83e9d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.278244:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e30d5f1/0x51de7f756a83e9d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.278257:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e30d5f1/0x51de7f756a83e9d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.278265:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e30d5f1/0x51de7f756a83e9d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.278281:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917065.278282:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917065.278284:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917065.281932:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.281952:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.281973:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.281978:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.281986:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.282002:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.282026:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.282035:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.282073:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788917065.282124:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788917065.282138:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917065.282194:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaa000 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788917065.282199:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917065.282212:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917065.282236:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917065.282243:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d622d5a/0x51de7f756a83e9dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917065.282282:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917065.282285:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917065.282290:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917065.282779:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.282786:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aba6d4b1/0x51de7f756a83e9e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.282795:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.282799:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.282803:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aba6d4b1/0x51de7f756a83e9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.282812:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aba6d4b1/0x51de7f756a83e9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.282821:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aba6d4b1/0x51de7f756a83e9e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.282828:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aba6d4b1/0x51de7f756a83e9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.282872:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788917065.283359:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788917065.283368:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aba6d4b1/0x51de7f756a83e9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917065.283378:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab600 already unused, calling callback (ffffffffc1729220) 00010000:00010000:2.0:1788917065.283382:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aba6d4b1/0x51de7f756a83e9e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917065.283390:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aba6d4b1/0x51de7f756a83e9e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917065.283414:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aba6d4b1/0x51de7f756a83e9e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917065.283421:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aba6d4b1/0x51de7f756a83e9e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917065.283445:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917065.283447:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917065.283449:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917065.288104:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.288119:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c95c3cf/0x51de7f756a83e9ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.288140:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.288167:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.288176:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c95c3cf/0x51de7f756a83e9ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.288192:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c95c3cf/0x51de7f756a83e9ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.288205:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c95c3cf/0x51de7f756a83e9ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.288213:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c95c3cf/0x51de7f756a83e9ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.288244:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788917065.288669:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.288676:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf132c9c/0x51de7f756a83e9f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.288685:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.288695:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.288701:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf132c9c/0x51de7f756a83e9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.288710:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf132c9c/0x51de7f756a83e9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.288719:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf132c9c/0x51de7f756a83e9f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.288726:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf132c9c/0x51de7f756a83e9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.288748:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788917065.288766:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788917065.288773:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c95c3cf/0x51de7f756a83e9ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.288781:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab400 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788917065.288787:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c95c3cf/0x51de7f756a83e9ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.288797:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c95c3cf/0x51de7f756a83e9ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.288817:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c95c3cf/0x51de7f756a83e9ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.288849:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c95c3cf/0x51de7f756a83e9ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.288864:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788917065.288879:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917065.288883:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917065.288886:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.289138:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.289187:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf132c9c/0x51de7f756a83e9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.289202:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeab800 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917065.289208:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf132c9c/0x51de7f756a83e9f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.289219:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf132c9c/0x51de7f756a83e9f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.289249:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf132c9c/0x51de7f756a83e9f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.289269:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf132c9c/0x51de7f756a83e9f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.289305:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.289308:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.289310:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.289317:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.289319:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917065.289526:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.289535:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cb2c25f/0x51de7f756a83e9f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.289545:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.289550:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.289555:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cb2c25f/0x51de7f756a83e9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.289566:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cb2c25f/0x51de7f756a83e9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.289576:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cb2c25f/0x51de7f756a83e9f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.289583:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cb2c25f/0x51de7f756a83e9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.289607:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788917065.289928:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917065.289935:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cb2c25f/0x51de7f756a83e9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.289945:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeabe00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917065.289949:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cb2c25f/0x51de7f756a83e9f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.289958:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cb2c25f/0x51de7f756a83e9f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.289974:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cb2c25f/0x51de7f756a83e9f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.289981:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cb2c25f/0x51de7f756a83e9f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.290016:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.290026:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.290029:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917065.290356:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.290371:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.290380:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.290384:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.290390:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.290401:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.290410:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.290417:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.290435:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788917065.290682:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917065.290691:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.290701:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaa400 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917065.290705:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.290714:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.290727:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.290734:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e924f015/0x51de7f756a83e9ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.290764:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.290767:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.290774:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917065.291067:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.291075:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafe945c/0x51de7f756a83ea06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.291086:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.291089:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.291095:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fafe945c/0x51de7f756a83ea06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.291107:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fafe945c/0x51de7f756a83ea06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.291124:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fafe945c/0x51de7f756a83ea06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.291132:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fafe945c/0x51de7f756a83ea06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.291179:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788917065.291432:0:16021:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917065.291440:0:16021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fafe945c/0x51de7f756a83ea06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.291449:0:16021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaba00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917065.291453:0:16021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafe945c/0x51de7f756a83ea06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.291471:0:16021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fafe945c/0x51de7f756a83ea06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.291491:0:16021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fafe945c/0x51de7f756a83ea06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.291499:0:16021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fafe945c/0x51de7f756a83ea06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.291517:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.291519:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.291520:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917065.291986:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.291994:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83ea0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.292004:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.292008:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.292015:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83ea0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.292025:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83ea0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.292034:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83ea0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.292041:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83ea0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.292072:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788917065.292730:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.292738:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095ced13e/0x51de7f756a83ea14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.292748:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.292752:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.292757:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095ced13e/0x51de7f756a83ea14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.292767:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095ced13e/0x51de7f756a83ea14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.292777:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095ced13e/0x51de7f756a83ea14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.292785:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095ced13e/0x51de7f756a83ea14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.292799:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788917065.293413:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.293419:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097beb866/0x51de7f756a83ea1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.293429:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.293439:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.293445:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097beb866/0x51de7f756a83ea1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.293456:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097beb866/0x51de7f756a83ea1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.293465:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097beb866/0x51de7f756a83ea1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.293473:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097beb866/0x51de7f756a83ea1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.293495:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788917065.294128:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.294136:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3cb984b/0x51de7f756a83ea22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.294169:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.294173:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.294177:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3cb984b/0x51de7f756a83ea22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.294188:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3cb984b/0x51de7f756a83ea22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.294198:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3cb984b/0x51de7f756a83ea22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.294212:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3cb984b/0x51de7f756a83ea22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.294223:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788917065.295059:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.295067:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021c6af95/0x51de7f756a83ea29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.295078:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.295082:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.295086:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021c6af95/0x51de7f756a83ea29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.295098:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021c6af95/0x51de7f756a83ea29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.295107:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021c6af95/0x51de7f756a83ea29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.295115:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021c6af95/0x51de7f756a83ea29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.295125:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788917065.295878:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.295886:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6489e27/0x51de7f756a83ea30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.295903:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.295906:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.295911:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6489e27/0x51de7f756a83ea30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.295920:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6489e27/0x51de7f756a83ea30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.295927:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6489e27/0x51de7f756a83ea30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.295934:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6489e27/0x51de7f756a83ea30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.295943:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788917065.296817:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.296825:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e5eb6fd/0x51de7f756a83ea37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.297014:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.297019:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.297025:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e5eb6fd/0x51de7f756a83ea37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.297037:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e5eb6fd/0x51de7f756a83ea37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.297058:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e5eb6fd/0x51de7f756a83ea37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.297066:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e5eb6fd/0x51de7f756a83ea37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.297076:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1788917065.298076:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.298086:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096e331cd/0x51de7f756a83ea3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.298098:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.298102:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.298107:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096e331cd/0x51de7f756a83ea3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.298117:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096e331cd/0x51de7f756a83ea3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.298128:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096e331cd/0x51de7f756a83ea3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.298136:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096e331cd/0x51de7f756a83ea3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.298183:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1788917065.298606:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.298612:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a3ccc1e/0x51de7f756a83ea45 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.298622:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.298625:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.298629:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a3ccc1e/0x51de7f756a83ea45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.298639:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a3ccc1e/0x51de7f756a83ea45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.298647:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a3ccc1e/0x51de7f756a83ea45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.298654:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a3ccc1e/0x51de7f756a83ea45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.298663:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1788917065.299112:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.299119:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009839eeea/0x51de7f756a83ea4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.299128:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.299140:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.299169:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009839eeea/0x51de7f756a83ea4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.299182:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009839eeea/0x51de7f756a83ea4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.299191:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009839eeea/0x51de7f756a83ea4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.299199:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009839eeea/0x51de7f756a83ea4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.299212:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:3.0:1788917065.299428:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1788917065.299442:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83ea0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299456:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeaaa00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917065.299462:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83ea0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299473:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83ea0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299494:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83ea0d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299514:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000368beb64/0x51de7f756a83ea0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299539:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788917065.299543:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095ced13e/0x51de7f756a83ea14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299550:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d3a00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917065.299554:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095ced13e/0x51de7f756a83ea14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299562:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095ced13e/0x51de7f756a83ea14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299572:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095ced13e/0x51de7f756a83ea14 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299579:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095ced13e/0x51de7f756a83ea14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299589:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788917065.299592:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097beb866/0x51de7f756a83ea1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299598:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d2c00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917065.299606:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097beb866/0x51de7f756a83ea1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299613:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097beb866/0x51de7f756a83ea1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299622:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097beb866/0x51de7f756a83ea1b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299629:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097beb866/0x51de7f756a83ea1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299648:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788917065.299652:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3cb984b/0x51de7f756a83ea22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299658:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d3000 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917065.299662:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3cb984b/0x51de7f756a83ea22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299669:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3cb984b/0x51de7f756a83ea22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299677:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3cb984b/0x51de7f756a83ea22 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299684:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3cb984b/0x51de7f756a83ea22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299708:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788917065.299712:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021c6af95/0x51de7f756a83ea29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299718:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d3800 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917065.299721:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021c6af95/0x51de7f756a83ea29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299729:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021c6af95/0x51de7f756a83ea29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299739:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021c6af95/0x51de7f756a83ea29 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299746:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021c6af95/0x51de7f756a83ea29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299767:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788917065.299770:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6489e27/0x51de7f756a83ea30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299778:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d2200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917065.299781:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6489e27/0x51de7f756a83ea30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299804:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6489e27/0x51de7f756a83ea30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299817:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6489e27/0x51de7f756a83ea30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299824:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6489e27/0x51de7f756a83ea30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299859:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788917065.299863:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e5eb6fd/0x51de7f756a83ea37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299870:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d2800 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917065.299873:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e5eb6fd/0x51de7f756a83ea37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299880:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e5eb6fd/0x51de7f756a83ea37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299889:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e5eb6fd/0x51de7f756a83ea37 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299896:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e5eb6fd/0x51de7f756a83ea37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299927:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788917065.299931:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096e331cd/0x51de7f756a83ea3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299938:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d3c00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917065.299941:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096e331cd/0x51de7f756a83ea3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299949:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096e331cd/0x51de7f756a83ea3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299958:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096e331cd/0x51de7f756a83ea3e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299965:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096e331cd/0x51de7f756a83ea3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299978:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788917065.299981:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a3ccc1e/0x51de7f756a83ea45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.299986:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d3200 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917065.299991:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a3ccc1e/0x51de7f756a83ea45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.300011:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a3ccc1e/0x51de7f756a83ea45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.300021:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a3ccc1e/0x51de7f756a83ea45 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.300029:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a3ccc1e/0x51de7f756a83ea45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.300053:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917065.300056:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009839eeea/0x51de7f756a83ea4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.300062:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d3600 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917065.300064:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009839eeea/0x51de7f756a83ea4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.300072:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009839eeea/0x51de7f756a83ea4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.300082:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009839eeea/0x51de7f756a83ea4c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.300089:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009839eeea/0x51de7f756a83ea4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788917065.300109:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788917065.300112:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.300116:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.300120:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917065.300120:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027def67b/0x51de7f756a83ea53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.300133:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917065.300134:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.300141:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.300175:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027def67b/0x51de7f756a83ea53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.300187:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027def67b/0x51de7f756a83ea53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.300195:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027def67b/0x51de7f756a83ea53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.300211:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027def67b/0x51de7f756a83ea53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.300232:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788917065.300267:0:14253:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917065.300273:0:14253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027def67b/0x51de7f756a83ea53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.300282:0:14253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d2e00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917065.300286:0:14253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027def67b/0x51de7f756a83ea53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.300294:0:14253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027def67b/0x51de7f756a83ea53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.300312:0:14253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027def67b/0x51de7f756a83ea53 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.300320:0:14253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027def67b/0x51de7f756a83ea53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.300340:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.300342:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.300346:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917065.300792:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.300801:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a28dbd4c/0x51de7f756a83ea5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.300810:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.300813:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.300818:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a28dbd4c/0x51de7f756a83ea5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.300829:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a28dbd4c/0x51de7f756a83ea5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.300849:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a28dbd4c/0x51de7f756a83ea5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.300856:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a28dbd4c/0x51de7f756a83ea5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.300875:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788917065.300941:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917065.300949:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a28dbd4c/0x51de7f756a83ea5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.300967:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d3400 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917065.300972:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a28dbd4c/0x51de7f756a83ea5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.300982:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a28dbd4c/0x51de7f756a83ea5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.300997:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a28dbd4c/0x51de7f756a83ea5a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.301004:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a28dbd4c/0x51de7f756a83ea5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.301030:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.301032:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.301035:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917065.301495:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.301503:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b158751/0x51de7f756a83ea61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.301522:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.301525:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.301530:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b158751/0x51de7f756a83ea61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.301540:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b158751/0x51de7f756a83ea61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.301549:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b158751/0x51de7f756a83ea61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.301557:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b158751/0x51de7f756a83ea61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.301582:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788917065.301863:0:16021:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788917065.301870:0:16021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b158751/0x51de7f756a83ea61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.301879:0:16021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d2400 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788917065.301883:0:16021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b158751/0x51de7f756a83ea61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.301893:0:16021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b158751/0x51de7f756a83ea61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.301922:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917065.301922:0:16021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b158751/0x51de7f756a83ea61 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.301933:0:16021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b158751/0x51de7f756a83ea61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.301952:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917065.301954:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917065.301956:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788917065.302208:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.302214:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fbe5d0a/0x51de7f756a83ea68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.302222:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.302225:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.302229:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fbe5d0a/0x51de7f756a83ea68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.302238:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fbe5d0a/0x51de7f756a83ea68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.302246:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fbe5d0a/0x51de7f756a83ea68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.302253:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fbe5d0a/0x51de7f756a83ea68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.302278:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788917065.302679:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788917065.302685:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031e0b901/0x51de7f756a83ea6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.302692:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788917065.302694:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917065.302698:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031e0b901/0x51de7f756a83ea6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.302707:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031e0b901/0x51de7f756a83ea6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.302715:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031e0b901/0x51de7f756a83ea6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.302722:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031e0b901/0x51de7f756a83ea6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.302734:0:14903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788917065.303170:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788917065.303182:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fbe5d0a/0x51de7f756a83ea68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.303194:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d2600 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917065.303198:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fbe5d0a/0x51de7f756a83ea68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.303209:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fbe5d0a/0x51de7f756a83ea68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.303238:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fbe5d0a/0x51de7f756a83ea68 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.303246:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fbe5d0a/0x51de7f756a83ea68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.303268:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917065.303272:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031e0b901/0x51de7f756a83ea6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.303278:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d2a00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917065.303281:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031e0b901/0x51de7f756a83ea6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.303288:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031e0b901/0x51de7f756a83ea6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.303297:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031e0b901/0x51de7f756a83ea6f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.303303:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031e0b901/0x51de7f756a83ea6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917065.303313:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.303314:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.303319:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917065.303325:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788917065.303543:0:14903:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1788917065.303686:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14289:x1875815140785792:12345-0@lo:5:osp-pre-1-0.0 Request processed in 50927us (52481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917065.303699:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788917065.303793:0:14289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37135180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14289:1875815140785792:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788917065.303821:0:14289:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1788917065.304481:0:14289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a680a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14289:1875815140786048:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788917065.304535:0:14289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917065.304567:0:14289:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e032f36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788917065.304596:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140786048 00000100:00100000:1.0:1788917065.304603:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140786048 00000100:00100000:1.0:1788917065.304657:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788917065.304670:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1875815140785920:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1788917065.340955:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788917065.361960:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3306:x1875815140785920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57284us (110433us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788917065.361976:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788917065.362010:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788917065.362023:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14289:x1875815140786048:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788917065.362073:0:14900:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:0.0:1788917065.366922:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788917065.366988:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:00080000:0.0:1788917065.367053:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6e37135880/2, rc 0, transno 8589934593 00000100:00100000:0.0:1788917065.367063:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140785920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788917065.378632:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14289:x1875815140786048:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16606us (74089us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788917065.378648:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788917065.380012:0:14289:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000004:00080000:3.0:1788917065.380026:0:14289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6e37135880, transno 8589934593 00000100:00100000:3.0:1788917065.380060:0:14289:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9a6e3a680a80 x1875815140786048/t8589934594(8589934594) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788917081 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788917065.380075:0:14289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a680a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14289:1875815140786048:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788917065.380092:0:14289:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000040:00080000:0.0:1788917065.381323:0:14288:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 1, last_idx 2 00000040:00080000:0.0:1788917065.381391:0:14288:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1788917065.522302:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917065.526455:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113528832 00000100:00100000:1.0:1788917065.526476:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113528832 00000100:00100000:1.0:1788917065.526541:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:1.0:1788917065.526551:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2370:x1875815113528832:12345-192.168.202.40@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788917065.526588:0:14259:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from a5830ca7-ca02-4e9b-acca-7d0b5e403502@192.168.202.40@tcp t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:1.0:1788917065.526624:0:14259:0:(genops.c:1407:class_connect()) connect: client a5830ca7-ca02-4e9b-acca-7d0b5e403502, cookie 0x51de7f756a83ea76 00000100:00080000:1.0:1788917065.526843:0:14259:0:(import.c:65:import_set_state_nolock()) ffff9a6e3f2a1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788917065.526936:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+5:2370:x1875815113528832:12345-192.168.202.40@tcp:250:mount.lustre.0 Request processed in 384us (4644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917065.526945:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:0.0:1788917065.541691:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917065.544798:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113528960 00000100:00100000:1.0:1788917065.544816:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113528960 00000100:00100000:1.0:1788917065.544899:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 74 00000100:00100000:1.0:1788917065.544910:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+5:13748:x1875815113528960:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788917065.544935:0:14258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788917065.544959:0:14258:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e1e9d2400/0x51de7f756a83ea7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f88e expref: -99 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.545007:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e1e9d2400/0x51de7f756a83ea7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f88e expref: 6 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.545018:0:14258:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e1e9d2400/0x51de7f756a83ea7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f88e expref: 6 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.545028:0:14258:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1e9d2400, rc 0) 00000100:00100000:1.0:1788917065.545104:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+6:13748:x1875815113528960:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 196us (3422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917065.545111:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 74 00000100:00100000:1.0:1788917065.550908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917065.551202:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113529088 00000100:00100000:0.0:1788917065.551213:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113529088 00000100:00100000:0.0:1788917065.551270:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:0.0:1788917065.551280:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+6:13748:x1875815113529088:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788917065.551583:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+6:13748:x1875815113529088:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 303us (686us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788917065.551590:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:2.0:1788917065.556217:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917065.556322:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113529216 00000100:00100000:0.0:1788917065.556334:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113529216 00000100:00100000:0.0:1788917065.556395:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:0.0:1788917065.556408:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+6:13748:x1875815113529216:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788917065.556431:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917065.556456:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83ea84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f895 expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917065.556492:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83ea84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f895 expref: 7 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917065.556506:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee2e00/0x51de7f756a83ea84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f895 expref: 7 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917065.556517:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2e00, rc 0) 00000100:00100000:0.0:1788917065.556592:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+7:13748:x1875815113529216:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 187us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917065.556600:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:2.0:1788917065.558215:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917065.558270:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113529344 00000100:00100000:0.0:1788917065.558278:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113529344 00000100:00100000:0.0:1788917065.558326:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:0.0:1788917065.558336:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+7:13748:x1875815113529344:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788917065.558689:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+8:13748:x1875815113529344:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 353us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917065.558705:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:2.0:1788917065.560132:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917065.560198:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113529472 00000100:00100000:1.0:1788917065.560206:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113529472 00000100:00100000:1.0:1788917065.560255:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:1.0:1788917065.560264:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+8:13748:x1875815113529472:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788917065.560486:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+8:13748:x1875815113529472:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 223us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917065.560494:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:2.0:1788917065.562452:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917065.562517:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113529600 00000100:00100000:1.0:1788917065.562526:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113529600 00000100:00100000:1.0:1788917065.562620:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:1.0:1788917065.562630:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+8:13766:x1875815113529600:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788917065.562936:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+8:13766:x1875815113529600:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 307us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917065.562945:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:2.0:1788917065.574386:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917065.576033:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113529728 00000100:00100000:1.0:1788917065.576049:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113529728 00000100:00100000:1.0:1788917065.576117:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:1.0:1788917065.576128:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+8:13766:x1875815113529728:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788917065.576445:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+8:13766:x1875815113529728:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 317us (2072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917065.576454:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:2.0:1788917065.581933:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917065.582045:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113529856 00000100:00100000:1.0:1788917065.582059:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113529856 00000100:00100000:1.0:1788917065.582143:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:1.0:1788917065.582216:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+8:13748:x1875815113529856:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788917065.582240:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788917065.582264:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e1e9d2000/0x51de7f756a83ea8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f8bf expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.582300:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e1e9d2000/0x51de7f756a83ea8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f8bf expref: 9 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.582313:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e1e9d2000/0x51de7f756a83ea8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f8bf expref: 9 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917065.582325:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1e9d2000, rc 0) 00000100:00100000:1.0:1788917065.582392:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+9:13748:x1875815113529856:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 179us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917065.582399:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:2.0:1788917065.587615:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917065.587728:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113529984 00000100:00100000:1.0:1788917065.587739:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113529984 00000100:00100000:1.0:1788917065.587902:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00100000:1.0:1788917065.587912:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+9:13748:x1875815113529984:12345-192.168.202.40@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788917065.587950:0:14258:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788917065.587971:0:14258:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788917065.587975:0:14258:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788917065.587979:0:14258:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788917065.587982:0:14258:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788917065.589591:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+9:13748:x1875815113529984:12345-192.168.202.40@tcp:256:mount.lustre.0 Request processed in 1672us (1982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917065.589606:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00100000:1.0:1788917065.599027:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917065.599111:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113530112 00000100:00100000:0.0:1788917065.599125:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113530112 00000100:00100000:0.0:1788917065.599265:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:0.0:1788917065.599279:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+9:13748:x1875815113530112:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788917065.599304:0:14257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917065.599328:0:14257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee3600/0x51de7f756a83ea92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f8c6 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917065.599365:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee3600/0x51de7f756a83ea92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f8c6 expref: 10 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917065.599378:0:14257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee3600/0x51de7f756a83ea92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f8c6 expref: 10 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917065.599388:0:14257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3600, rc 0) 00000100:00100000:0.0:1788917065.599457:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+10:13748:x1875815113530112:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 181us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917065.599466:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:2.0:1788917065.605648:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917065.606304:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113530240 00000100:00100000:1.0:1788917065.606322:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113530240 00000100:00100000:1.0:1788917065.606416:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:1.0:1788917065.606428:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+10:13748:x1875815113530240:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788917065.606801:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+10:13748:x1875815113530240:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 375us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917065.606812:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:2.0:1788917065.609408:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917065.609621:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113530368 00000100:00100000:0.0:1788917065.609632:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113530368 00000100:00100000:0.0:1788917065.609698:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00100000:0.0:1788917065.609710:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+10:13748:x1875815113530368:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788917065.610101:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+10:13748:x1875815113530368:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 391us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917065.610110:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00100000:2.0:1788917065.612439:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917065.612599:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113530496 00000100:00100000:0.0:1788917065.612610:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113530496 00000100:00100000:0.0:1788917065.612752:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:0.0:1788917065.612763:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+10:13770:x1875815113530496:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788917065.613085:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+10:13770:x1875815113530496:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 323us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917065.613095:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:0.0:1788917065.617006:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917065.617232:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113530624 00000100:00100000:1.0:1788917065.617244:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113530624 00000100:00100000:1.0:1788917065.617334:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 87 00000100:00100000:1.0:1788917065.617343:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+10:13770:x1875815113530624:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788917065.617617:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+10:13770:x1875815113530624:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 273us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917065.617625:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 87 00000100:00100000:3.0:1788917065.619914:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917065.620027:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113530752 00000100:00100000:1.0:1788917065.620052:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113530752 00000100:00100000:1.0:1788917065.620103:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:1.0:1788917065.620111:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2370:x1875815113530752:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788917065.620331:0:14264:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 92610db9-d8ec-4111-b657-7a2541e0ec4f@192.168.202.40@tcp t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:1.0:1788917065.620394:0:14264:0:(genops.c:1407:class_connect()) connect: client 92610db9-d8ec-4111-b657-7a2541e0ec4f, cookie 0x51de7f756a83ea99 00000004:00100000:1.0:1788917065.620433:0:14264:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788917065.620441:0:14264:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1788917065.632756:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788917065.646890:0:14264:0:(import.c:65:import_set_state_nolock()) ffff9a6e3f2a7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788917065.647118:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2370:x1875815113530752:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 27003us (27210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917065.647132:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:2.0:1788917065.653032:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917065.653120:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917065.654389:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113531008 00000100:00100000:3.0:1788917065.654403:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113531008 00000100:00100000:3.0:1788917065.654495:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113530880 00000100:00100000:3.0:1788917065.654499:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113530880 00000100:00100000:3.0:1788917065.654520:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:3.0:1788917065.654531:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:13748:x1875815113531008:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788917065.654590:0:14266:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788917065.654690:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:13748:x1875815113531008:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 159us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917065.654698:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:3.0:1788917065.654718:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:3.0:1788917065.654725:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:0:x1875815113530880:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788917065.654737:0:14266:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788917065.654760:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:0:x1875815113530880:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 36us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917065.654788:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00080000:1.0:1788917065.655302:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917065.657180:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917065.657242:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113531136 00000100:00100000:3.0:1788917065.657251:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113531136 00000100:00100000:3.0:1788917065.657305:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:3.0:1788917065.657316:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:13748:x1875815113531136:12345-192.168.202.40@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788917065.657398:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:13748:x1875815113531136:12345-192.168.202.40@tcp:40:mount.lustre.0 Request processed in 84us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917065.657407:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:3.0:1788917065.658893:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917065.659466:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917065.659530:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113531264 00000100:00100000:3.0:1788917065.659539:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113531264 00000100:00100000:2.0:1788917065.659552:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917065.659573:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113531392 00000100:00100000:3.0:1788917065.659577:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113531392 00000100:00100000:3.0:1788917065.659593:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:3.0:1788917065.659600:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2370:x1875815113531264:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788917065.659636:0:14903:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 92610db9-d8ec-4111-b657-7a2541e0ec4f@192.168.202.40@tcp t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:3.0:1788917065.659685:0:14903:0:(genops.c:1407:class_connect()) connect: client 92610db9-d8ec-4111-b657-7a2541e0ec4f, cookie 0x51de7f756a83eaa0 00002000:00100000:3.0:1788917065.659700:0:14903:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 92610db9-d8ec-4111-b657-7a2541e0ec4f/ffff9a6e1ea0a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788917065.659730:0:14903:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788917065.660120:0:14903:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1788917065.661089:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113531520 00000100:00100000:0.0:1788917065.661097:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113531520 00000100:00080000:3.0:1788917065.661303:0:14903:0:(import.c:65:import_set_state_nolock()) ffff9a6e1ea0f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788917065.661402:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2370:x1875815113531264:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 1799us (2511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917065.661411:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:3.0:1788917065.661432:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:3.0:1788917065.661463:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2370:x1875815113531392:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788917065.661487:0:14903:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 92610db9-d8ec-4111-b657-7a2541e0ec4f@192.168.202.40@tcp t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:3.0:1788917065.661515:0:14903:0:(genops.c:1407:class_connect()) connect: client 92610db9-d8ec-4111-b657-7a2541e0ec4f, cookie 0x51de7f756a83eaa7 00002000:00100000:3.0:1788917065.661526:0:14903:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 92610db9-d8ec-4111-b657-7a2541e0ec4f/ffff9a6e1ea0a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788917065.661536:0:14903:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788917065.661569:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:0.0:1788917065.661578:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:13748:x1875815113531520:12345-192.168.202.40@tcp:33:mount.lustre.0 00002000:00080000:3.0:1788917065.662438:0:14903:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788917065.662467:0:14903:0:(import.c:65:import_set_state_nolock()) ffff9a6e1ea0f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788917065.662509:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2370:x1875815113531392:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 1044us (3043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917065.662517:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000004:00080000:3.0:1788917065.665049:0:14267:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3407us 00000004:00200000:3.0:1788917065.673904:0:14267:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1788917065.674087:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:13748:x1875815113531520:12345-192.168.202.40@tcp:33:mount.lustre.0 Request processed in 12503us (14528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917065.674103:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:2.0:1788917065.793375:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917065.793492:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113531648 00000100:00100000:0.0:1788917065.793504:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113531648 00000100:00100000:0.0:1788917065.793582:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:0.0:1788917065.793594:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:13791:x1875815113531648:12345-192.168.202.40@tcp:101:mkdir.0 00010000:00010000:0.0:1788917065.793627:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917065.793670:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2000/0x51de7f756a83eaae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f8f0 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917065.793757:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2a00/0x51de7f756a83eab5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917065.793776:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2a00/0x51de7f756a83eab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917065.799932:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2a00/0x51de7f756a83eab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917065.800275:0:14265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788917065.800279:0:14265:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1788917065.800364:0:14265:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2a00/0x51de7f756a83eab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917065.800403:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2000/0x51de7f756a83eaae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f8f0 expref: 8 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917065.800422:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2a00/0x51de7f756a83eab5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f8f0 expref: 7 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917065.800431:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86100) 00010000:00010000:0.0:1788917065.800435:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788917065.800439:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2a00, rc 0) 00000100:00100000:0.0:1788917065.800532:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:13791:x1875815113531648:12345-192.168.202.40@tcp:101:mkdir.0 Request processed in 6938us (7169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917065.800541:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000040:00080000:0.0:1788917065.888507:0:14298:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788917065.888524:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917065.888911:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788917065.888918:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:3.0:1788917066.301714:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 92610db9-d8ec-4111-b657-7a2541e0ec4f 00010000:00010000:3.0:1788917066.655379:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917067.390022:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917067.390960:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113531776 00000100:00100000:1.0:1788917067.390978:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113531776 00000100:00080000:2.0:1788917067.391076:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917067.391093:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:1.0:1788917067.391112:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:13843:x1875815113531776:12345-192.168.202.40@tcp:41:lfs.0 00000004:00000024:1.0:1788917067.391223:0:14266:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788917067.391339:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:13843:x1875815113531776:12345-192.168.202.40@tcp:41:lfs.0 Request processed in 234us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917067.391348:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:1.0:1788917067.395122:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917067.395326:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113531904 00000100:00100000:2.0:1788917067.395340:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113531904 00000100:00100000:2.0:1788917067.395471:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:2.0:1788917067.395484:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:92610db9-d8ec-4111-b657-7a2541e0ec4f+5:13843:x1875815113531904:12345-192.168.202.40@tcp:13:lfs.0 00002000:00000024:2.0:1788917067.395540:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917067.395640:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:92610db9-d8ec-4111-b657-7a2541e0ec4f+5:13843:x1875815113531904:12345-192.168.202.40@tcp:13:lfs.0 Request processed in 158us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917067.395651:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00080000:1.0:1788917067.395715:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917067.397860:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917067.399530:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113532032 00000100:00100000:3.0:1788917067.399546:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113532032 00000100:00100000:3.0:1788917067.399629:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:3.0:1788917067.399640:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:13843:x1875815113532032:12345-192.168.202.40@tcp:13:lfs.0 00002000:00000024:3.0:1788917067.399682:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788917067.399707:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788917067.399788:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:13843:x1875815113532032:12345-192.168.202.40@tcp:13:lfs.0 Request processed in 148us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917067.399825:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:3.0:1788917067.523300:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917067.528806:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113532160 00000100:00100000:0.0:1788917067.528855:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113532160 00000100:00100000:0.0:1788917067.528949:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:0.0:1788917067.528961:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+10:13875:x1875815113532160:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788917067.528980:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917067.529001:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee2000/0x51de7f756a83eabc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f8f7 expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917067.529048:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee2000/0x51de7f756a83eabc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f8f7 expref: 11 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917067.529060:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee2000/0x51de7f756a83eabc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f8f7 expref: 11 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917067.529069:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2000, rc 0) 00000100:00100000:0.0:1788917067.529252:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+11:13875:x1875815113532160:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 292us (5960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917067.529261:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:1.0:1788917067.540851:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917067.540983:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113532288 00000100:00100000:3.0:1788917067.540994:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113532288 00000100:00100000:3.0:1788917067.541062:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:3.0:1788917067.541073:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+11:13875:x1875815113532288:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788917067.541657:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+11:13875:x1875815113532288:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 584us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917067.541728:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:2.0:1788917067.544800:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917067.547182:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113532416 00000100:00100000:1.0:1788917067.547197:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113532416 00000100:00100000:1.0:1788917067.547271:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 90 00000100:00100000:1.0:1788917067.547296:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+11:13875:x1875815113532416:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788917067.547645:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+11:13875:x1875815113532416:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 351us (2850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917067.547655:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 90 00000100:00100000:0.0:1788917067.550196:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917067.550275:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113532544 00000100:00100000:3.0:1788917067.550286:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113532544 00000100:00100000:3.0:1788917067.550363:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 91 00000100:00100000:3.0:1788917067.550371:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+11:13882:x1875815113532544:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788917067.550802:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+11:13882:x1875815113532544:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 431us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917067.550808:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 91 00000100:00100000:2.0:1788917067.558323:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917067.558389:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113532672 00000100:00100000:1.0:1788917067.558400:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113532672 00000100:00100000:1.0:1788917067.558783:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 92 00000100:00100000:1.0:1788917067.558796:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+11:13882:x1875815113532672:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788917067.559119:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+11:13882:x1875815113532672:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 326us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917067.559128:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 92 00000100:00100000:2.0:1788917067.562108:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917067.562383:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113532800 00000100:00100000:0.0:1788917067.562396:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113532800 00000100:00100000:0.0:1788917067.562523:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 93 00000100:00100000:0.0:1788917067.562534:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+11:13875:x1875815113532800:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788917067.562552:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917067.562572:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee3800/0x51de7f756a83eac3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f921 expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917067.562599:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee3800/0x51de7f756a83eac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f921 expref: 12 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917067.562610:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee3800/0x51de7f756a83eac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f921 expref: 12 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917067.562618:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee3800, rc 0) 00000100:00100000:0.0:1788917067.562720:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+12:13875:x1875815113532800:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 187us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917067.562739:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 93 00000100:00100000:0.0:1788917067.567202:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917067.567367:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113532928 00000100:00100000:1.0:1788917067.567379:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113532928 00000100:00100000:1.0:1788917067.567436:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 94 00000100:00100000:1.0:1788917067.567456:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+12:13875:x1875815113532928:12345-192.168.202.40@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788917067.567626:0:14257:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788917067.567668:0:14257:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788917067.567673:0:14257:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788917067.567676:0:14257:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788917067.567678:0:14257:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788917067.572513:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+12:13875:x1875815113532928:12345-192.168.202.40@tcp:256:mount.lustre.0 Request processed in 5058us (5309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917067.572528:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 94 00000100:00100000:2.0:1788917067.575280:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917067.575398:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113533056 00000100:00100000:0.0:1788917067.575410:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113533056 00000100:00100000:0.0:1788917067.575650:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 95 00000100:00100000:0.0:1788917067.575661:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+12:13875:x1875815113533056:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788917067.575679:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917067.575699:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83eaca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f928 expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917067.575726:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83eaca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f928 expref: 13 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917067.575736:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83eaca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f928 expref: 13 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917067.575745:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e06ee2200, rc 0) 00000100:00100000:0.0:1788917067.575857:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:13875:x1875815113533056:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 197us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917067.575865:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 95 00000100:00100000:0.0:1788917067.578827:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917067.579024:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113533184 00000100:00100000:1.0:1788917067.579037:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113533184 00000100:00100000:1.0:1788917067.579096:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 96 00000100:00100000:1.0:1788917067.579121:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:13875:x1875815113533184:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788917067.579577:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:13875:x1875815113533184:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 456us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917067.579586:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 96 00000100:00100000:2.0:1788917067.585236:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917067.585989:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113533312 00000100:00100000:0.0:1788917067.586003:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113533312 00000100:00100000:0.0:1788917067.586071:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 97 00000100:00100000:0.0:1788917067.586082:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:13875:x1875815113533312:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788917067.586609:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:13875:x1875815113533312:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 528us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917067.586625:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 97 00000100:00100000:2.0:1788917067.589525:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917067.589774:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113533440 00000100:00100000:1.0:1788917067.589785:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113533440 00000100:00100000:1.0:1788917067.589851:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 98 00000100:00100000:1.0:1788917067.589861:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:13886:x1875815113533440:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788917067.590190:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:13886:x1875815113533440:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 329us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917067.590198:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 98 00000100:00100000:1.0:1788917067.592951:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917067.593092:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113533568 00000100:00100000:3.0:1788917067.593102:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113533568 00000100:00100000:3.0:1788917067.593223:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 99 00000100:00100000:3.0:1788917067.593234:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:13886:x1875815113533568:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788917067.593483:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:13886:x1875815113533568:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 249us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917067.593491:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 99 00000100:00100000:2.0:1788917067.611865:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917067.612131:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113533696 00000100:00100000:0.0:1788917067.612142:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113533696 00000100:00100000:0.0:1788917067.612233:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:0.0:1788917067.612244:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2370:x1875815113533696:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788917067.612277:0:14265:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 5ef94afb-c48b-479f-853f-434eacee288c@192.168.202.40@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:0.0:1788917067.612318:0:14265:0:(genops.c:1407:class_connect()) connect: client 5ef94afb-c48b-479f-853f-434eacee288c, cookie 0x51de7f756a83ead1 00000004:00100000:0.0:1788917067.612349:0:14265:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788917067.612483:0:14265:0:(import.c:65:import_set_state_nolock()) ffff9a6e36bac800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788917067.612553:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2370:x1875815113533696:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 309us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917067.612561:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:2.0:1788917067.617300:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917067.617341:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917067.617549:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113533824 00000100:00100000:0.0:1788917067.617559:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113533824 00000100:00100000:0.0:1788917067.617631:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113533952 00000100:00100000:0.0:1788917067.617634:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113533952 00000100:00100000:0.0:1788917067.617651:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:0.0:1788917067.617661:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+7:0:x1875815113533824:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788917067.617694:0:14265:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788917067.617772:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+7:0:x1875815113533824:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 112us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917067.617779:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:0.0:1788917067.617797:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:0.0:1788917067.617804:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:13875:x1875815113533952:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788917067.617826:0:14265:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788917067.617867:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:13875:x1875815113533952:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 64us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917067.617875:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00080000:2.0:1788917067.617940:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917067.619398:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917067.619514:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113534080 00000100:00100000:3.0:1788917067.619530:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113534080 00000100:00100000:3.0:1788917067.619577:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:3.0:1788917067.619585:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:13875:x1875815113534080:12345-192.168.202.40@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788917067.619654:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:13875:x1875815113534080:12345-192.168.202.40@tcp:40:mount.lustre.0 Request processed in 69us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917067.619661:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:2.0:1788917067.622778:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917067.622842:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917067.622879:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917067.623237:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113534208 00000100:00100000:0.0:1788917067.623248:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113534208 00000100:00100000:0.0:1788917067.623292:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113534336 00000100:00100000:0.0:1788917067.623295:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113534336 00000100:00100000:0.0:1788917067.623311:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:0.0:1788917067.623320:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2370:x1875815113534208:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788917067.623354:0:14900:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 5ef94afb-c48b-479f-853f-434eacee288c@192.168.202.40@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:0.0:1788917067.623388:0:14900:0:(genops.c:1407:class_connect()) connect: client 5ef94afb-c48b-479f-853f-434eacee288c, cookie 0x51de7f756a83ead8 00002000:00100000:0.0:1788917067.623400:0:14900:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5ef94afb-c48b-479f-853f-434eacee288c/ffff9a6e36ba8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788917067.623425:0:14900:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788917067.623688:0:14900:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788917067.623719:0:14900:0:(import.c:65:import_set_state_nolock()) ffff9a6e36bab800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788917067.623789:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:2370:x1875815113534208:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 468us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917067.623798:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:0.0:1788917067.623830:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:0.0:1788917067.623835:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2370:x1875815113534336:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788917067.623851:0:14900:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 5ef94afb-c48b-479f-853f-434eacee288c@192.168.202.40@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:0.0:1788917067.623867:0:14900:0:(genops.c:1407:class_connect()) connect: client 5ef94afb-c48b-479f-853f-434eacee288c, cookie 0x51de7f756a83eadf 00002000:00100000:0.0:1788917067.623872:0:14900:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5ef94afb-c48b-479f-853f-434eacee288c/ffff9a6e36baf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371a ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788917067.623878:0:14900:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788917067.624091:0:14900:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788917067.624105:0:14900:0:(import.c:65:import_set_state_nolock()) ffff9a6e36bad800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788917067.624140:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:2370:x1875815113534336:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 304us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917067.624187:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:0.0:1788917067.628726:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113534464 00000100:00100000:0.0:1788917067.628742:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113534464 00000100:00100000:0.0:1788917067.628906:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:0.0:1788917067.628917:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:13875:x1875815113534464:12345-192.168.202.40@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788917067.629320:0:14268:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1788917067.629487:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:13875:x1875815113534464:12345-192.168.202.40@tcp:33:mount.lustre.0 Request processed in 571us (6606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917067.629496:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00010000:00010000:3.0:1788917067.681028:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917067.736755:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917067.736868:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113534592 00000100:00100000:3.0:1788917067.736879:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113534592 00000100:00100000:3.0:1788917067.736943:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:3.0:1788917067.736953:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:13907:x1875815113534592:12345-192.168.202.40@tcp:101:mkdir.0 00010000:00010000:3.0:1788917067.736975:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917067.737010:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83eae6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f952 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917067.737083:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eaed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917067.737098:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eaed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917067.737112:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eaed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917067.737387:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788917067.737393:0:14266:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788917067.737478:0:14266:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eaed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917067.737510:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83eae6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f952 expref: 8 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917067.737536:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eaed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f952 expref: 7 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917067.737546:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86100) 00010000:00010000:3.0:1788917067.737549:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788917067.737553:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f800, rc 0) 00000100:00100000:3.0:1788917067.737618:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+7:13907:x1875815113534592:12345-192.168.202.40@tcp:101:mkdir.0 Request processed in 666us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917067.737625:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:3.0:1788917068.321393:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140786176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788917068.321486:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917068.321733:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140786176 00000100:00100000:1.0:1788917068.321751:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140786176 00000100:00080000:2.0:1788917068.321829:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917068.323496:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788917068.323522:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140786176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788917068.323559:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917068.323668:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140786176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (2182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917068.323677:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788917068.323752:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140786176:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788917068.703646:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788917069.319051:0:16130:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788917069.727953:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917070.367301:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140786688:0@lo:400:kworker.0 00000100:00100000:2.0:1788917070.367321:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f625f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140786304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788917070.367377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917070.367381:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917070.367455:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140786432:0@lo:400:kworker.0 00000100:00100000:3.0:1788917070.367458:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788917070.367464:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140786816:0@lo:400:kworker.0 00000100:00100000:3.0:1788917070.367494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917070.367494:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917070.367522:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140786944:0@lo:400:kworker.0 00000100:00100000:0.0:1788917070.367651:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140786688 00000100:00100000:0.0:1788917070.367661:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140786688 00000100:00080000:3.0:1788917070.367705:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788917070.367730:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788917070.367738:0:14903:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788917070.367743:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875815140786688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917070.367750:0:14903:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788917070.367756:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140786560:0@lo:400:kworker.0 00000100:00100000:2.0:1788917070.367810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917070.367834:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140787072:0@lo:400:kworker.0 00000100:00100000:3.0:1788917070.367848:0:14901:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788917070.367855:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875815140786688:12345-0@lo:400:kworker.0 Request processed in 114us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917070.367857:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140786560 00000100:00100000:3.0:1788917070.367863:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140786560 00000100:00100000:2.0:1788917070.367865:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917070.367871:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788917070.367907:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140786304 00000100:00100000:3.0:1788917070.367909:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788917070.367912:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140786304 00000100:00100000:3.0:1788917070.367922:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140786560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917070.367938:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788917070.367945:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875815140786304:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917070.367959:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140786560:12345-0@lo:400:kworker.0 Request processed in 38us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917070.367966:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00000024:2.0:1788917070.367974:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788917070.367980:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917070.368007:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875815140786304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917070.368015:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788917070.368182:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140786816 00000100:00100000:2.0:1788917070.368187:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140786816 00000100:00100000:2.0:1788917070.368220:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140787072 00000100:00100000:2.0:1788917070.368223:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140787072 00000100:00100000:2.0:1788917070.368246:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788917070.368253:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140786816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917070.368288:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f624e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140786816:12345-0@lo:400:kworker.0 Request processed in 36us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917070.368294:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788917070.368307:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788917070.368313:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140787072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917070.368342:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140787072:12345-0@lo:400:kworker.0 Request processed in 29us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917070.368355:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788917070.368376:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917070.368581:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140786560:0@lo:400:kworker.0 00000100:00100000:2.0:1788917070.368595:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140787072:0@lo:400:kworker.0 00000100:00100000:2.0:1788917070.368634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917070.368675:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f625f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140786304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917070.368677:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140786944 00000100:00100000:3.0:1788917070.368684:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140786944 00000100:00080000:2.0:1788917070.368706:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917070.368731:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788917070.368739:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140786944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917070.368797:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140786944:12345-0@lo:400:kworker.0 Request processed in 48us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917070.368804:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788917070.369085:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140786944:0@lo:400:kworker.0 00000100:00100000:0.0:1788917070.371599:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140786432 00000100:00100000:0.0:1788917070.371612:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140786432 00000100:00100000:0.0:1788917070.371671:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788917070.371684:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140786432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917070.371800:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140786432:12345-0@lo:400:kworker.0 Request processed in 108us (4294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917070.371808:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788917070.371928:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140786432:0@lo:400:kworker.0 00000100:00100000:1.0:1788917070.374278:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140786816:0@lo:400:kworker.0 00000100:00100000:1.0:1788917070.374306:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140786688:0@lo:400:kworker.0 00000001:00100000:0.0:1788917070.420297:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5ef94afb-c48b-479f-853f-434eacee288c 00000001:00080000:0.0:1788917070.420318:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00100000:0.0:1788917070.420333:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 92610db9-d8ec-4111-b657-7a2541e0ec4f 00010000:00010000:3.0:1788917070.751868:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788917070.917177:0:5814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5ef94afb-c48b-479f-853f-434eacee288c 00000001:00100000:0.0:1788917070.917201:0:5814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 92610db9-d8ec-4111-b657-7a2541e0ec4f 00000020:00000080:1.0:1788917071.278101:0:16282:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda90b0ae0 20000000:00000080:1.0:1788917071.278119:0:16282:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6e1ea38800 uarg=0000000000000000 20000000:01000000:1.0:1788917071.278305:0:16282:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788917071.278312:0:16282:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788917071.278317:0:16282:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788917071.278942:0:16283:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788917071.279119:0:16282:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788917071.283866:0:16282:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788917071.283897:0:16282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6e1e9d2600/0x51de7f756a83eaf4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917071.283918:0:16282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e06ee3200/0x51de7f756a83e7eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e7e4 expref: 18 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917071.283927:0:16282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e838 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e831 expref: 18 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917071.283935:0:16282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e1eeaac00/0x51de7f756a83e973 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83e96c expref: 18 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917071.283945:0:16282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e06ee3600/0x51de7f756a83ea92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f8c6 expref: 12 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917071.283952:0:16282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83eaca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f928 expref: 12 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917071.283960:0:16282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6e1e9d2600/0x51de7f756a83eaf4 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917071.284002:0:16282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83eaca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f928 expref: 12 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917071.284034:0:16282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83eaca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f928 expref: 12 pid: 14259 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917071.284052:0:16282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16282:1875815140787200:192.168.202.40@tcp:104: 00010000:00010000:1.0:1788917071.284191:0:16282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e06ee3600/0x51de7f756a83ea92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f8c6 expref: 12 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917071.284200:0:16282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6e06ee3600/0x51de7f756a83ea92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f8c6 expref: 12 pid: 14257 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917071.284210:0:16282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a682d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16282:1875815140787328:192.168.202.40@tcp:104: 00010000:00010000:1.0:1788917071.284239:0:16282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e1eeaac00/0x51de7f756a83e973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83e96c expref: 18 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917071.284248:0:16282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6e1eeaac00/0x51de7f756a83e973 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83e96c expref: 18 pid: 14259 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917071.284256:0:16282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a682300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16282:1875815140787456:0@lo:104: 00000100:00100000:1.0:1788917071.284296:0:16282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788917071.284331:0:16282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e838 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83e831 expref: 18 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917071.284339:0:16282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e838 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83e831 expref: 18 pid: 14259 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917071.284347:0:16282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a80a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16282:1875815140787584:0@lo:104: 00000100:00100000:1.0:1788917071.284363:0:16282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917071.284407:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140787456 00000100:00100000:1.0:1788917071.284415:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140787456 00000100:00100000:1.0:1788917071.284454:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140787584 00000100:00100000:1.0:1788917071.284457:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140787584 00000100:00100000:1.0:1788917071.284468:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788917071.284476:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+4:16282:x1875815140787456:12345-0@lo:104: 00010000:00010000:1.0:1788917071.284488:0:14249:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83e96c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83e973 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917071.284530:0:14249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788917071.284536:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+4:16282:x1875815140787456:12345-0@lo:104: Request processed in 61us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917071.284542:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788917071.284557:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788917071.284562:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+3:16282:x1875815140787584:12345-0@lo:104: 00010000:00010000:1.0:1788917071.284569:0:14249:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18e800/0x51de7f756a83e831 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83e838 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917071.284592:0:14249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788917071.284596:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+3:16282:x1875815140787584:12345-0@lo:104: Request processed in 34us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917071.284601:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788917071.284623:0:16282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6e06ee3200/0x51de7f756a83e7eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x51de7f756a83e7e4 expref: 18 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917071.284632:0:16282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6e06ee3200/0x51de7f756a83e7eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x51de7f756a83e7e4 expref: 18 pid: 14257 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917071.284640:0:16282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a83480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16282:1875815140787712:0@lo:104: 00000100:00100000:1.0:1788917071.284666:0:16282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917071.284690:0:14249:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788917071.284698:0:14249:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140787712 00000100:00100000:1.0:1788917071.284701:0:14249:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140787712 00000100:00100000:1.0:1788917071.284714:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788917071.284719:0:14249:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcae850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+3:16282:x1875815140787712:12345-0@lo:104: 00010000:00010000:1.0:1788917071.284726:0:14249:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83e7e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83e7eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917071.284750:0:14249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788917071.284754:0:14249:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcae850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+3:16282:x1875815140787712:12345-0@lo:104: Request processed in 36us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917071.284759:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788917071.284804:0:16282:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e2cf276c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788917071.284825:0:16282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a682300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16282:1875815140787456:0@lo:104: 00000100:00100000:1.0:1788917071.284832:0:16282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a80a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16282:1875815140787584:0@lo:104: 00000100:00100000:1.0:1788917071.284837:0:16282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a83480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16282:1875815140787712:0@lo:104: 00010000:00010000:3.0:1788917071.285122:0:16021:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788917071.285130:0:16021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83e96c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83e973 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285139:0:16021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f000 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1788917071.285160:0:16021:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83e96c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83e973 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285170:0:16021:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83e96c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83e973 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788917071.285178:0:16021:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83e96c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83e973 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788917071.285185:0:16021:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788917071.285215:0:16021:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83e96c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e973 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285227:0:16021:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788917071.285248:0:16021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83e96c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e973 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285255:0:16021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18f000/0x51de7f756a83e96c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e973 expref: -99 pid: 15571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285269:0:16021:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788917071.285272:0:16021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18e800/0x51de7f756a83e831 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83e838 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285278:0:16021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e800 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1788917071.285281:0:16021:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18e800/0x51de7f756a83e831 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83e838 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285288:0:16021:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18e800/0x51de7f756a83e831 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83e838 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788917071.285294:0:16021:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18e800/0x51de7f756a83e831 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83e838 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788917071.285300:0:16021:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788917071.285311:0:16021:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18e800/0x51de7f756a83e831 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e838 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285317:0:16021:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788917071.285322:0:16021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18e800/0x51de7f756a83e831 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e838 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285328:0:16021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e2d18e800/0x51de7f756a83e831 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e838 expref: -99 pid: 14899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285341:0:16021:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917071.285344:0:16021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83e7e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x51de7f756a83e7eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285350:0:16021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1eeabc00 already unused, calling callback (ffffffffc1d46c20) 10000000:00010000:3.0:1788917071.285353:0:16021:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83e7e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x51de7f756a83e7eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285359:0:16021:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83e7e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x51de7f756a83e7eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788917071.285365:0:16021:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83e7e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x51de7f756a83e7eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788917071.285370:0:16021:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788917071.285379:0:16021:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83e7e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e7eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285384:0:16021:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788917071.285394:0:16021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83e7e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e7eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285400:0:16021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9a6e1eeabc00/0x51de7f756a83e7e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x51de7f756a83e7eb expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285411:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917071.285413:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917071.285415:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917071.285421:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917071.285430:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917071.285447:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f625880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140787840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788917071.285478:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917071.285499:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788917071.285504:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f624a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140787968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788917071.285524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917071.285548:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140787840 00000100:00100000:3.0:1788917071.285552:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140787840 00010000:00010000:3.0:1788917071.285569:0:14251:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e1eeaac00/0x51de7f756a83e973 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83e96c expref: 19 pid: 14259 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917071.285586:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140787968 00000100:00100000:3.0:1788917071.285589:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140787968 00010000:00010000:3.0:1788917071.285597:0:14251:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e838 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83e831 expref: 20 pid: 14259 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917071.285608:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788917071.285614:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f627100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+20:3306:x1875815140787840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788917071.285622:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917071.285627:0:14251:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e1eeaac00/0x51de7f756a83e973 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83e96c expref: 20 pid: 14259 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285637:0:14251:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e1eeaac00/0x51de7f756a83e973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83e96c expref: 20 pid: 14259 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285649:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e1eeaac00/0x51de7f756a83e973 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83e96c expref: 20 pid: 14259 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285661:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917071.285682:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f627100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140787840:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917071.285696:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788917071.285710:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788917071.285715:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f625500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:3306:x1875815140787968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788917071.285721:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917071.285726:0:14251:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e838 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83e831 expref: 18 pid: 14259 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285734:0:14251:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e838 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83e831 expref: 18 pid: 14259 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285744:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83e838 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83e831 expref: 18 pid: 14259 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.285754:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917071.285771:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f625500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:3306:x1875815140787968:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917071.285776:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788917071.285823:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f624a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140787968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788917071.285832:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f625880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140787840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788917071.286132:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f625c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140788096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788917071.286186:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917071.286448:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140788096 00000100:00100000:3.0:1788917071.286453:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140788096 00010000:00010000:3.0:1788917071.286471:0:14251:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e06ee3200/0x51de7f756a83e7eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83e7e4 expref: 17 pid: 14257 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917071.286506:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788917071.286513:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2ea8c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:3304:x1875815140788096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788917071.286521:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917071.286533:0:14251:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e06ee3200/0x51de7f756a83e7eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x51de7f756a83e7e4 expref: 17 pid: 14257 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.286541:0:14251:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e06ee3200/0x51de7f756a83e7eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x51de7f756a83e7e4 expref: 17 pid: 14257 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.286553:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e06ee3200/0x51de7f756a83e7eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x51de7f756a83e7e4 expref: 17 pid: 14257 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917071.286563:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917071.286594:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2ea8c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:3304:x1875815140788096:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917071.286600:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788917071.286653:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f625c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140788096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788917071.288001:0:16282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16282:1875815140787200:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917071.288014:0:16282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a682d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16282:1875815140787328:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788917071.288057:0:16282:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6e1e9d2600/0x51de7f756a83eaf4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917071.289090:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917071.289711:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917071.289894:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113534720 00000100:00100000:0.0:1788917071.289903:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113534720 00010000:00010000:0.0:1788917071.289951:0:14250:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83eaca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f928 expref: 13 pid: 14259 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917071.289988:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113534848 00000100:00100000:0.0:1788917071.289992:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113534848 00010000:00010000:0.0:1788917071.290005:0:14250:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6e06ee3600/0x51de7f756a83ea92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f8c6 expref: 14 pid: 14257 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917071.290021:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1788917071.290031:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f625c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+14:2373:x1875815113534720:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788917071.290045:0:14250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917071.290051:0:14250:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83eaca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f928 expref: 14 pid: 14259 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917071.290081:0:14250:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83eaca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f928 expref: 14 pid: 14259 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917071.290099:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e06ee2200/0x51de7f756a83eaca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f928 expref: 14 pid: 14259 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917071.290114:0:14250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788917071.290196:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f625c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2373:x1875815113534720:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 165us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917071.290204:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1788917071.290222:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:0.0:1788917071.290229:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f627100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+12:2372:x1875815113534848:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788917071.290236:0:14250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917071.290241:0:14250:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6e06ee3600/0x51de7f756a83ea92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f8c6 expref: 12 pid: 14257 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917071.290250:0:14250:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6e06ee3600/0x51de7f756a83ea92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f8c6 expref: 12 pid: 14257 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917071.290261:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e06ee3600/0x51de7f756a83ea92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f8c6 expref: 12 pid: 14257 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917071.290272:0:14250:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6e1e9d2600/0x51de7f756a83eaf4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917071.290281:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e1e9d2600/0x51de7f756a83eaf4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917071.290309:0:14250:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e1e9d2600/0x51de7f756a83eaf4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917071.290316:0:14250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6e1e9d2600/0x51de7f756a83eaf4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917071.290323:0:14250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6e1e9d2600/0x51de7f756a83eaf4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917071.290330:0:14250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6e1e9d2600/0x51de7f756a83eaf4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917071.290336:0:14250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d2600 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788917071.290340:0:14250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6e1e9d2600/0x51de7f756a83eaf4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917071.290348:0:14250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6e1e9d2600/0x51de7f756a83eaf4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917071.290364:0:14250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6e1e9d2600/0x51de7f756a83eaf4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917071.290373:0:14250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788917071.290394:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f627100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+11:2372:x1875815113534848:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 164us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917071.290400:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00010000:00010000:0.0:1788917071.290423:0:16282:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6e1e9d2600/0x51de7f756a83eaf4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917071.290432:0:16282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6e1e9d2600/0x51de7f756a83eaf4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917071.290444:0:16282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6e1e9d2600/0x51de7f756a83eaf4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788917071.415010:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5ef94afb-c48b-479f-853f-434eacee288c 00010000:00010000:3.0:1788917071.776469:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917072.775615:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917072.775657:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917072.775687:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917072.775707:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917072.775722:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917072.775737:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917072.775756:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917072.775801:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113535488 00000100:00100000:0.0:1788917072.775811:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113535488 00000100:00100000:0.0:1788917072.775867:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113535104 00000100:00100000:0.0:1788917072.775869:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113535104 00000100:00100000:0.0:1788917072.775887:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:0.0:1788917072.775896:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:2374:x1875815113535488:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917072.775973:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:2374:x1875815113535488:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 78us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917072.775981:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:0.0:1788917072.775996:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:0.0:1788917072.776001:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113535104:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917072.776019:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113535104:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 18us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917072.776025:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:0.0:1788917072.776050:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113535232 00000100:00100000:0.0:1788917072.776053:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113535232 00000100:00100000:0.0:1788917072.776071:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113535744 00000100:00100000:0.0:1788917072.776073:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113535744 00000100:00100000:0.0:1788917072.776083:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113535360 00000100:00100000:0.0:1788917072.776085:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113535360 00000100:00100000:0.0:1788917072.776094:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113535616 00000100:00100000:0.0:1788917072.776096:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113535616 00000100:00100000:0.0:1788917072.776108:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:0.0:1788917072.776113:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+5:2374:x1875815113535232:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917072.776140:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+5:2374:x1875815113535232:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 27us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917072.776170:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:0.0:1788917072.776181:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:0.0:1788917072.776187:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ef94afb-c48b-479f-853f-434eacee288c+5:2374:x1875815113535744:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917072.776222:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ef94afb-c48b-479f-853f-434eacee288c+5:2374:x1875815113535744:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 36us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917072.776228:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:0.0:1788917072.776237:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1788917072.776242:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+5:2374:x1875815113535360:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917072.776262:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+5:2374:x1875815113535360:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 20us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917072.776268:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1788917072.776277:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:0.0:1788917072.776283:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ef94afb-c48b-479f-853f-434eacee288c+5:2374:x1875815113535616:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917072.776304:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ef94afb-c48b-479f-853f-434eacee288c+5:2374:x1875815113535616:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 22us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917072.776316:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00080000:0.0:1788917072.776340:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788917072.776343:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788917072.776346:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917072.776696:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113534976 00000100:00100000:3.0:1788917072.776702:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113534976 00000100:00100000:3.0:1788917072.779486:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 101 00000100:00100000:3.0:1788917072.779508:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+11:2374:x1875815113534976:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917072.779643:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+11:2374:x1875815113534976:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 142us (4041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917072.779652:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 101 10000000:01000000:2.0:1788917072.802448:0:14262:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788917072.802456:0:14262:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e1eae5000 from 10 10000000:01000000:2.0:1788917072.802461:0:14262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788917072.802517:0:14262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83eafb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.802531:0:14262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83eafb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.802544:0:14262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83eafb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917072.802577:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140788224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788917072.802659:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917072.802705:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e1ee00600 going to sleep for 11 seconds 00000100:00100000:0.0:1788917072.803075:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140788224 00000100:00100000:0.0:1788917072.803085:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140788224 00000100:00100000:2.0:1788917072.803218:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788917072.803247:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+16:14262:x1875815140788224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788917072.803268:0:14257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917072.803284:0:14257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83eb02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83eafb expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.803315:0:14257:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83eb02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83eafb expref: 17 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.803327:0:14257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e00030a00/0x51de7f756a83eb02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83eafb expref: 17 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.803337:0:14257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00030a00, rc 0) 00000100:00100000:2.0:1788917072.803394:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:14262:x1875815140788224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917072.803402:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788917072.803458:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140788224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788917072.803476:0:14262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83eafb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83eb02 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.803485:0:14262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83eafb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83eb02 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917072.803549:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140788352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788917072.803575:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788917072.803731:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917072.803743:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140788352 00000100:00100000:3.0:1788917072.803747:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140788352 00000100:00100000:3.0:1788917072.803781:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788917072.803787:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:14262:x1875815140788352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788917072.804197:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:14262:x1875815140788352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 410us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917072.804205:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788917072.806943:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e39540 going to sleep for 11 seconds 00000100:00100000:2.0:1788917072.806997:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140788352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788917072.807062:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140788480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788917072.807156:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917072.807179:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e39540 going to sleep for 11 seconds 00000100:00100000:2.0:1788917072.807202:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140788480 00000100:00100000:2.0:1788917072.807207:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140788480 00000100:00100000:2.0:1788917072.807251:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788917072.807260:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:14262:x1875815140788480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788917072.807468:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:14262:x1875815140788480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917072.807476:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788917072.807525:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140788480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788917072.808123:0:16392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788917072.808199:0:14262:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788917072.808218:0:14262:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788917072.808232:0:14262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83eafb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83eb02 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.808243:0:14262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e00031600/0x51de7f756a83eafb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83eb02 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788917072.808255:0:14262:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788917072.808258:0:14262:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e3fe0e800 from 10 10000000:01000000:2.0:1788917072.808262:0:14262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788917072.808293:0:14262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83eb09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.808302:0:14262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83eb09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.808313:0:14262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83eb09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917072.808336:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140788608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788917072.808371:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917072.808390:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e39480 going to sleep for 11 seconds 00000100:00100000:2.0:1788917072.808406:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140788608 00000100:00100000:2.0:1788917072.808410:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140788608 00000100:00100000:2.0:1788917072.808439:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788917072.808446:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+17:14262:x1875815140788608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788917072.808457:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917072.808473:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e00031200/0x51de7f756a83eb10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83eb09 expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.808497:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e00031200/0x51de7f756a83eb10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83eb09 expref: 18 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.808508:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e00031200/0x51de7f756a83eb10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83eb09 expref: 18 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.808518:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e00031200, rc 0) 00000100:00100000:2.0:1788917072.808547:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:14262:x1875815140788608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917072.808553:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788917072.808588:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140788608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788917072.808602:0:14262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83eb09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83eb10 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.808612:0:14262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83eb09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83eb10 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917072.808660:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140788736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788917072.808686:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917072.808699:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e39480 going to sleep for 11 seconds 00000100:00100000:2.0:1788917072.808712:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140788736 00000100:00100000:2.0:1788917072.808715:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140788736 00000100:00100000:2.0:1788917072.808735:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788917072.808740:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:14262:x1875815140788736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788917072.809013:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:14262:x1875815140788736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917072.809020:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788917072.809050:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140788736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788917072.809076:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140788864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788917072.809108:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917072.809122:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e04cb5540 going to sleep for 11 seconds 00000100:00100000:2.0:1788917072.809132:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140788864 00000100:00100000:2.0:1788917072.809136:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140788864 00000100:00100000:2.0:1788917072.809172:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788917072.809178:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:14262:x1875815140788864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788917072.809302:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:14262:x1875815140788864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917072.809308:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788917072.809344:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140788864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788917072.815560:0:16393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788917072.815787:0:14262:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788917072.815825:0:14262:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788917072.815838:0:14262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83eb09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83eb10 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.815853:0:14262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e00030e00/0x51de7f756a83eb09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83eb10 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788917072.815864:0:14262:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788917072.815867:0:14262:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a6e05362800 from 10 10000000:01000000:2.0:1788917072.815871:0:14262:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788917072.815921:0:14262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f000/0x51de7f756a83eb17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.815930:0:14262:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f000/0x51de7f756a83eb17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.815941:0:14262:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f000/0x51de7f756a83eb17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917072.815971:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140788992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788917072.816054:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917072.816438:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e04cb5540 going to sleep for 11 seconds 00000100:00100000:2.0:1788917072.816462:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140788992 00000100:00100000:2.0:1788917072.816470:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140788992 00000100:00100000:2.0:1788917072.816552:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788917072.816562:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+18:14262:x1875815140788992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788917072.816579:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917072.816595:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e0168f600/0x51de7f756a83eb1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x51de7f756a83eb17 expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.816635:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0168f600/0x51de7f756a83eb1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x51de7f756a83eb17 expref: 19 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.816646:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e0168f600/0x51de7f756a83eb1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x51de7f756a83eb17 expref: 19 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.816655:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f600, rc 0) 00000100:00100000:2.0:1788917072.816696:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:14262:x1875815140788992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917072.816703:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788917072.817776:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140788992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788917072.817803:0:14262:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f000/0x51de7f756a83eb17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83eb1e expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.817816:0:14262:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f000/0x51de7f756a83eb17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x51de7f756a83eb1e expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917072.817892:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140789120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788917072.817939:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917072.818010:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e04cb5540 going to sleep for 11 seconds 00000100:00100000:0.0:1788917072.818051:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140789120 00000100:00100000:0.0:1788917072.818057:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140789120 00000100:00100000:0.0:1788917072.818322:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788917072.818332:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:14262:x1875815140789120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788917072.818655:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:14262:x1875815140789120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917072.818663:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788917072.818727:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140789120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788917072.818757:0:14262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140789248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788917072.818805:0:14262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917072.818825:0:14262:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e04cb5540 going to sleep for 11 seconds 00000100:00100000:2.0:1788917072.818836:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140789248 00000100:00100000:2.0:1788917072.818845:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140789248 00000100:00100000:2.0:1788917072.818867:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788917072.818873:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:14262:x1875815140789248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788917072.819018:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:14262:x1875815140789248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917072.819025:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788917072.819058:0:14262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:14262:1875815140789248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788917072.819845:0:16394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788917072.819900:0:14262:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788917072.819917:0:14262:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788917072.819927:0:14262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f000/0x51de7f756a83eb17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83eb1e expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917072.819937:0:14262:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9a6e0168f000/0x51de7f756a83eb17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x51de7f756a83eb1e expref: -99 pid: 14262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917073.095666:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917073.095819:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113535872 00000100:00100000:2.0:1788917073.095832:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113535872 00000100:00100000:2.0:1788917073.095965:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 111 00000100:00100000:2.0:1788917073.095977:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+11:13762:x1875815113535872:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788917073.096001:0:14259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917073.096026:0:14259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e0168e200/0x51de7f756a83eb25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f959 expref: -99 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.096064:0:14259:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e0168e200/0x51de7f756a83eb25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f959 expref: 12 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.096077:0:14259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e0168e200/0x51de7f756a83eb25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f959 expref: 12 pid: 14259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.096103:0:14259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168e200, rc 0) 00000100:00100000:2.0:1788917073.096209:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+12:13762:x1875815113535872:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 234us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917073.096217:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 111 00000100:00100000:3.0:1788917073.099999:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917073.104718:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113536000 00000100:00100000:0.0:1788917073.104735:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113536000 00000100:00100000:0.0:1788917073.104806:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 112 00000100:00100000:0.0:1788917073.104818:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+12:13762:x1875815113536000:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788917073.105257:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+12:13762:x1875815113536000:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 439us (5269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917073.105267:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 112 00000100:00100000:1.0:1788917073.107056:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917073.107168:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113536128 00000100:00100000:0.0:1788917073.107179:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113536128 00000100:00100000:0.0:1788917073.107277:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 113 00000100:00100000:0.0:1788917073.107289:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+12:13762:x1875815113536128:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788917073.107552:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+12:13762:x1875815113536128:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 265us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917073.107580:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 113 00000100:00100000:3.0:1788917073.114198:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917073.120477:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113536256 00000100:00100000:1.0:1788917073.120500:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113536256 00000100:00100000:1.0:1788917073.120688:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 114 00000100:00100000:1.0:1788917073.120711:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+12:13762:x1875815113536256:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788917073.120735:0:14258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788917073.120777:0:14258:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6e1e9d3c00/0x51de7f756a83eb2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f960 expref: -99 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.120813:0:14258:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6e1e9d3c00/0x51de7f756a83eb2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f960 expref: 13 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.120845:0:14258:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6e1e9d3c00/0x51de7f756a83eb2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f960 expref: 13 pid: 14258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.120857:0:14258:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1e9d3c00, rc 0) 00000100:00100000:1.0:1788917073.120964:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:13762:x1875815113536256:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 256us (6822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917073.120972:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 114 00000100:00100000:0.0:1788917073.136268:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917073.138420:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113536384 00000100:00100000:2.0:1788917073.138439:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113536384 00000100:00100000:2.0:1788917073.138595:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:2.0:1788917073.138608:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:13762:x1875815113536384:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788917073.139296:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:13762:x1875815113536384:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 689us (3039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917073.139305:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:0.0:1788917073.143295:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917073.143415:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113536512 00000100:00100000:1.0:1788917073.143427:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113536512 00000100:00100000:1.0:1788917073.143494:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:1.0:1788917073.143506:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:13762:x1875815113536512:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788917073.144242:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:13762:x1875815113536512:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 735us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917073.144252:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:1.0:1788917073.440647:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917073.440700:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113536640 00000100:00100000:0.0:1788917073.440705:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140789376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917073.440711:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113536640 00000100:00100000:0.0:1788917073.440790:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917073.440799:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:1.0:1788917073.440813:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:14417:x1875815113536640:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788917073.440840:0:14264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788917073.440869:0:14264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83eb33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f967 expref: -99 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.440941:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb3a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.440982:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441000:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441018:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3000/0x51de7f756a83eb41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441026:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3000/0x51de7f756a83eb41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441033:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3000/0x51de7f756a83eb41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441567:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2c00/0x51de7f756a83eb48 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441578:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2c00/0x51de7f756a83eb48 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441586:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2c00/0x51de7f756a83eb48 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788917073.441670:0:14264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788917073.441674:0:14264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788917073.441777:0:14264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2c00/0x51de7f756a83eb48 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441790:0:14264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441807:0:14264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb3a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441815:0:14264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441821:0:14264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d3800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917073.441826:0:14264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441834:0:14264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb3a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441847:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86100) 00010000:00010000:1.0:1788917073.441850:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788917073.441856:0:14264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441863:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441876:0:14264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3000/0x51de7f756a83eb41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441882:0:14264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3000/0x51de7f756a83eb41 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441887:0:14264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3000/0x51de7f756a83eb41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441892:0:14264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d3000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917073.441901:0:14264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3000/0x51de7f756a83eb41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441907:0:14264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3000/0x51de7f756a83eb41 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441914:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a6e19456500) 00010000:00010000:1.0:1788917073.441917:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788917073.441919:0:14264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3000/0x51de7f756a83eb41 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441925:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3000/0x51de7f756a83eb41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441957:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83eb33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f967 expref: 8 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441971:0:14264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2c00/0x51de7f756a83eb48 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f967 expref: 7 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.441978:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6e19456d00) 00010000:00010000:1.0:1788917073.441980:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788917073.441983:0:14264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1e9d2c00, rc 0) 00000100:00100000:1.0:1788917073.442052:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:14417:x1875815113536640:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 1243us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917073.442059:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:2.0:1788917073.442205:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140789376 00000100:00100000:2.0:1788917073.442212:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140789376 00000100:00100000:2.0:1788917073.442281:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788917073.442291:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140789376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788917073.442330:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917073.442389:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140789376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917073.442397:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788917073.442447:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f625500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140789376:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788917073.442948:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917073.444448:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917073.445732:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113536896 00000100:00100000:2.0:1788917073.445750:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113536896 00000100:00100000:2.0:1788917073.446221:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:2.0:1788917073.446235:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:14417:x1875815113536896:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788917073.446266:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917073.446317:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb4f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f96e expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.446409:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb56 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.446425:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.446439:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.446516:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb5d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.446524:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.446532:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.448318:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83eb64 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.448340:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83eb64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.448349:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83eb64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917073.448364:0:14265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788917073.448694:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.448712:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb56 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.448720:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb56 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.448727:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917073.448733:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb56 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.448741:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb56 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.448755:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6e19456d00) 00010000:00010000:2.0:1788917073.448770:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917073.448777:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb56 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.448784:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb56 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.448801:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.448807:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb5d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.448813:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb5d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.448818:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917073.448827:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb5d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.448833:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb5d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.450006:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a6e02f3ca00) 00010000:00010000:2.0:1788917073.450014:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917073.450021:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb5d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.450031:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb5d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.450688:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb4f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f96e expref: 10 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.450711:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ee00/0x51de7f756a83eb64 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f96e expref: 9 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.450721:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6e02f3c500) 00010000:00010000:2.0:1788917073.450723:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917073.450726:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168ee00, rc 0) 00000100:00100000:2.0:1788917073.450851:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+9:14417:x1875815113536896:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 4607us (6400us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788917073.450864:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:0.0:1788917073.462631:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917073.462828:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113537024 00000100:00100000:1.0:1788917073.462905:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113537024 00000100:00100000:1.0:1788917073.463041:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:1.0:1788917073.463070:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+9:14417:x1875815113537024:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788917073.463324:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+9:14417:x1875815113537024:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 254us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917073.463333:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:3.0:1788917073.474940:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917073.475043:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113537152 00000100:00100000:2.0:1788917073.475060:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113537152 00000100:00100000:2.0:1788917073.475140:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:2.0:1788917073.475197:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+9:14423:x1875815113537152:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788917073.475245:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917073.475273:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f975 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.475349:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.475369:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.475383:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.475399:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.475407:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.475414:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.475732:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.475740:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb79 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.475747:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.475753:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917073.475775:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.475784:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.475799:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86100) 00010000:00010000:2.0:1788917073.475802:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917073.475807:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.475813:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eb79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.475828:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.475833:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.475986:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.475990:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917073.475993:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.475999:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.476008:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a6e02f3ca00) 00010000:00010000:2.0:1788917073.476010:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917073.476019:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.476025:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83eb80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.476062:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb72 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f975 expref: 10 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.476074:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86100) 00010000:00010000:2.0:1788917073.476077:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917073.476080:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f975 expref: 10 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.476089:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168fc00, rc 0) 00000100:00100000:2.0:1788917073.476429:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f625880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+9:14423:x1875815113537152:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1234us (1498us total) trans 0 rc 301/301 00000100:00100000:2.0:1788917073.476439:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:1.0:1788917073.479752:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917073.480754:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113537280 00000100:00100000:2.0:1788917073.480778:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113537280 00000100:00100000:1.0:1788917073.480877:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:1.0:1788917073.480891:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:92610db9-d8ec-4111-b657-7a2541e0ec4f+9:14423:x1875815113537280:12345-192.168.202.40@tcp:700:lfs.0 00000100:00100000:2.0:1788917073.480902:0:14273:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:2.0:1788917073.480915:0:14273:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:1.0:1788917073.482569:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:92610db9-d8ec-4111-b657-7a2541e0ec4f+9:14423:x1875815113537280:12345-192.168.202.40@tcp:700:lfs.0 Request processed in 1672us (2821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917073.482586:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:0.0:1788917073.485803:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917073.485891:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113537536 00000100:00100000:2.0:1788917073.485905:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113537536 00000100:00100000:2.0:1788917073.485974:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:2.0:1788917073.485988:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+9:14423:x1875815113537536:12345-192.168.202.40@tcp:36:lfs.0 00010000:00010000:2.0:1788917073.486057:0:14264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917073.486091:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e06ee2a00/0x51de7f756a83eab5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f8f0 expref: 9 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.486127:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86100) 00010000:00010000:2.0:1788917073.486134:0:14264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788917073.486454:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb87 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.486470:0:14264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eaed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f952 expref: 5 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.486481:0:14264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb87 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.486968:0:14264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eaed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f952 expref: 5 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.486986:0:14264:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eaed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f952 expref: 5 pid: 14266 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917073.487003:0:14264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14264:1875815140789504:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788917073.487116:0:14264:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e08eef0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788917073.491654:0:14264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14264:1875815140789504:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788917073.491695:0:14264:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb87 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917073.492426:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917073.493554:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113537664 00000100:00100000:3.0:1788917073.493569:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113537664 00010000:00010000:3.0:1788917073.493626:0:14250:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eaed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f952 expref: 6 pid: 14266 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917073.494047:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:3.0:1788917073.494059:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:2374:x1875815113537664:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917073.494092:0:14250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917073.494101:0:14250:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eaed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f952 expref: 6 pid: 14266 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917073.494118:0:14250:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eaed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f952 expref: 6 pid: 14266 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917073.494305:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eaed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f952 expref: 6 pid: 14266 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917073.494330:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86100) 00010000:00010000:3.0:1788917073.494336:0:14250:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb87 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917073.494433:0:14250:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917073.494442:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb87 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917073.494471:0:14250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917073.494552:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ef94afb-c48b-479f-853f-434eacee288c+5:2374:x1875815113537664:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 495us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917073.494561:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00010000:00010000:1.0:1788917073.494649:0:14264:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.494658:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.494689:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb8e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.494701:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.494710:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788917073.496353:0:14264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788917073.496372:0:14264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.496382:0:14264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb87 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.496390:0:14264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.496402:0:14264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168fc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917073.496407:0:14264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.496416:0:14264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb87 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.496432:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86100) 00010000:00010000:1.0:1788917073.496434:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788917073.496440:0:14264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb87 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.496446:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83eb87 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788917073.496469:0:14264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d6552c1 reply state 00000000b9680e4e transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917073.496479:0:14264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788917073.496591:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+10:14423:x1875815113537536:12345-192.168.202.40@tcp:36:lfs.0 Request processed in 10602us (10798us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788917073.496600:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00010000:00010000:2.0:1788917073.498816:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.498837:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb8e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.498844:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb8e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.498870:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d3800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917073.498875:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb8e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.498884:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb8e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.498900:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a6e19456500) 00010000:00010000:2.0:1788917073.498903:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917073.498907:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb8e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.498913:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83eb8e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917073.540634:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917073.540733:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113537792 00000100:00100000:0.0:1788917073.540747:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113537792 00000100:00100000:0.0:1788917073.541014:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:0.0:1788917073.541027:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+9:14431:x1875815113537792:12345-192.168.202.40@tcp:101:lctl.0 00010000:00010000:0.0:1788917073.541060:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917073.541092:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa400/0x51de7f756a83eb95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f97c expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.541233:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa600/0x51de7f756a83eb9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.541250:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa600/0x51de7f756a83eb9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.541262:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa600/0x51de7f756a83eb9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917073.541334:0:14265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788917073.541338:0:14265:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1788917073.541386:0:14265:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa600/0x51de7f756a83eb9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.541410:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa400/0x51de7f756a83eb95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f97c expref: 11 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.541433:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa600/0x51de7f756a83eb9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f97c expref: 10 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.541442:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:0.0:1788917073.541445:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788917073.541450:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e3bcaa600, rc 0) 00000100:00100000:0.0:1788917073.541522:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+10:14431:x1875815113537792:12345-192.168.202.40@tcp:101:lctl.0 Request processed in 498us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917073.541531:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:0.0:1788917073.557726:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917073.557873:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113537920 00000100:00100000:1.0:1788917073.557886:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113537920 00000100:00100000:1.0:1788917073.557959:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:1.0:1788917073.557970:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ef94afb-c48b-479f-853f-434eacee288c+5:14432:x1875815113537920:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1788917073.558000:0:14264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788917073.558026:0:14264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3a00/0x51de7f756a83eba3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f983 expref: -99 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.558123:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83ebaa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.558140:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83ebaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.558190:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83ebaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788917073.558264:0:14264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788917073.558268:0:14264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1788917073.558296:0:14264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83ebaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.558323:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3a00/0x51de7f756a83eba3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f983 expref: 7 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.558345:0:14264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3800/0x51de7f756a83ebaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f983 expref: 6 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.558355:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:1.0:1788917073.558358:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788917073.558363:0:14264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1e9d3800, rc 0) 00000100:00100000:1.0:1788917073.558438:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:14432:x1875815113537920:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 470us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917073.558446:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:2.0:1788917073.560514:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917073.560673:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113538048 00000100:00100000:0.0:1788917073.560700:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113538048 00000100:00100000:0.0:1788917073.560774:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:0.0:1788917073.560785:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:14432:x1875815113538048:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1788917073.560810:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917073.560919:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa400/0x51de7f756a83ebb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f98a expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.560993:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561010:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561022:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561036:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561043:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561050:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561302:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabe00/0x51de7f756a83ebc6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561309:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabe00/0x51de7f756a83ebc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561314:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabe00/0x51de7f756a83ebc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917073.561352:0:14265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788917073.561355:0:14265:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788917073.561373:0:14265:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabe00/0x51de7f756a83ebc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561383:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561388:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebb8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561392:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561396:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcaaa00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917073.561399:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561405:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebb8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561414:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:0.0:1788917073.561416:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917073.561419:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561422:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561431:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561441:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebbf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561445:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561447:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcaa000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917073.561449:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561452:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebbf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561456:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a6e03d86500) 00010000:00010000:0.0:1788917073.561457:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917073.561459:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebbf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561462:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561484:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa400/0x51de7f756a83ebb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f98a expref: 8 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561493:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabe00/0x51de7f756a83ebc6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f98a expref: 7 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.561498:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e03d86a00) 00010000:00010000:0.0:1788917073.561500:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788917073.561505:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e3bcabe00, rc 0) 00000100:00100000:0.0:1788917073.561613:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+7:14432:x1875815113538048:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 829us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917073.561620:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:2.0:1788917073.572969:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917073.573063:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113538304 00000100:00100000:3.0:1788917073.573085:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113538304 00000100:00100000:3.0:1788917073.573308:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:3.0:1788917073.573320:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+7:14432:x1875815113538304:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788917073.573349:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917073.573384:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83ebcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f991 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917073.573521:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788917073.573673:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83ebcd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f991 expref: 9 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917073.573692:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:3.0:1788917073.573695:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788917073.573701:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83ebcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f991 expref: 9 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917073.573720:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f800, rc 0) 00000100:00100000:3.0:1788917073.573821:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+8:14432:x1875815113538304:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 504us (868us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788917073.573829:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:1.0:1788917073.578734:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917073.578996:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113538560 00000100:00100000:2.0:1788917073.579008:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113538560 00000100:00100000:2.0:1788917073.579124:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:2.0:1788917073.579137:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+8:14432:x1875815113538560:12345-192.168.202.40@tcp:36:lfs.0 00010000:00010000:2.0:1788917073.579239:0:14265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917073.579277:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabe00/0x51de7f756a83ebc6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f98a expref: 8 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.579299:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e03d86a00) 00010000:00010000:2.0:1788917073.579312:0:14265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788917073.579535:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ebdb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.579554:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ebdb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.579566:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ebdb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788917073.579915:0:14265:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000006d862d7 reply state 000000006cc16465 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ebdb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917073.579927:0:14265:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788917073.579944:0:14265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1788917073.580280:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+9:14432:x1875815113538560:12345-192.168.202.40@tcp:36:lfs.0 Request processed in 1143us (1560us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788917073.580290:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:2.0:1788917073.583825:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917073.584472:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113538816 00000100:00100000:3.0:1788917073.584484:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113538816 00000100:00100000:3.0:1788917073.584554:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:3.0:1788917073.584566:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ef94afb-c48b-479f-853f-434eacee288c+9:14432:x1875815113538816:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1788917073.585015:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ef94afb-c48b-479f-853f-434eacee288c+10:14432:x1875815113538816:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 451us (1201us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788917073.585022:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00010000:00010000:0.0:1788917073.587326:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ebdb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.587344:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ebdb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917073.587352:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:0.0:1788917073.587352:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ebdb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.587358:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168ec00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917073.587363:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ebdb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.587372:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ebdb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.587392:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3ca00) 00010000:00010000:0.0:1788917073.587396:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788917073.587401:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ebdb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.587408:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ebdb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917073.587654:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113539072 00000100:00100000:0.0:1788917073.587666:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113539072 00000100:00100000:0.0:1788917073.587726:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:0.0:1788917073.587736:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+9:14432:x1875815113539072:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1788917073.587795:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917073.587816:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa400/0x51de7f756a83ebe2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f998 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589199:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebe9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589223:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebe9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589236:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebe9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589253:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebf0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589260:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589266:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917073.589433:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788917073.589554:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebe9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589562:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebe9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589569:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebe9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589592:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcaa000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917073.589596:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebe9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589604:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebe9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589617:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:0.0:1788917073.589620:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917073.589624:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebe9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589631:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ebe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589646:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589651:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebf0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589656:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589661:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcaaa00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917073.589664:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589670:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebf0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589689:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a6e03d86500) 00010000:00010000:0.0:1788917073.589691:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917073.589694:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebf0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589700:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ebf0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589747:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa400/0x51de7f756a83ebe2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f998 expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589770:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:0.0:1788917073.589773:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788917073.589777:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa400/0x51de7f756a83ebe2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f998 expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.589788:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e3bcaa400, rc 0) 00000100:00100000:0.0:1788917073.590049:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+10:14432:x1875815113539072:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 2312us (2699us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788917073.590058:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:1.0:1788917073.592922:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917073.593133:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113539200 00000100:00100000:2.0:1788917073.593175:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113539200 00000100:00100000:2.0:1788917073.593236:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:2.0:1788917073.593247:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+10:14432:x1875815113539200:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788917073.593279:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917073.593307:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ebfe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f99f expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.593409:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ec05 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.593439:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ec05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.593465:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ec05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917073.593526:0:14265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788917073.593530:0:14265:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788917073.593554:0:14265:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ec05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.593593:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ebfe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f99f expref: 12 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.593616:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ec05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f99f expref: 11 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.593625:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:2.0:1788917073.593627:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788917073.593631:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f400, rc 0) 00000100:00100000:2.0:1788917073.593704:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+11:14432:x1875815113539200:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 458us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917073.593711:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:3.0:1788917073.597836:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917073.597976:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113539328 00000100:00100000:0.0:1788917073.597986:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113539328 00000100:00100000:0.0:1788917073.598043:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:0.0:1788917073.598052:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ef94afb-c48b-479f-853f-434eacee288c+11:14432:x1875815113539328:12345-192.168.202.40@tcp:37:lfs.0 00000100:00100000:1.0:1788917073.610349:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5ef94afb-c48b-479f-853f-434eacee288c+11:14432:x1875815113539328:12345-192.168.202.40@tcp:37:lfs.0 Request processed in 12278us (12509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917073.610373:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:1.0:1788917073.617089:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917073.617320:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113539584 00000100:00100000:2.0:1788917073.617332:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113539584 00000100:00100000:2.0:1788917073.617400:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:2.0:1788917073.617412:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edd8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ef94afb-c48b-479f-853f-434eacee288c+11:14432:x1875815113539584:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1788917073.617735:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edd8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5ef94afb-c48b-479f-853f-434eacee288c+12:14432:x1875815113539584:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 324us (671us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788917073.617744:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:3.0:1788917073.678792:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917073.679135:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113539712 00000100:00100000:0.0:1788917073.679198:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113539712 00000100:00100000:0.0:1788917073.679270:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:0.0:1788917073.679309:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+10:14438:x1875815113539712:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1788917073.679339:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917073.679377:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa400/0x51de7f756a83ec0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f9a6 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679456:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ec13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679474:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ec13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679487:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ec13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679504:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ec1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679510:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ec1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679515:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ec1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679630:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaba00/0x51de7f756a83ec21 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679635:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaba00/0x51de7f756a83ec21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679639:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaba00/0x51de7f756a83ec21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917073.679676:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788917073.679679:0:14266:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788917073.679711:0:14266:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaba00/0x51de7f756a83ec21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679722:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ec13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679726:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ec13 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679731:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ec13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679735:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcaaa00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917073.679738:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ec13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679743:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ec13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679753:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:0.0:1788917073.679767:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917073.679773:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ec13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679780:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83ec13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679799:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ec1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679815:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ec1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679821:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ec1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679826:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcaa000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917073.679829:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ec1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.679835:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ec1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.680096:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a6e03d86500) 00010000:00010000:0.0:1788917073.680099:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917073.680102:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ec1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.680109:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83ec1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.680367:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa400/0x51de7f756a83ec0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9a6 expref: 12 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.680385:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaba00/0x51de7f756a83ec21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9a6 expref: 11 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.680393:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:0.0:1788917073.680395:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788917073.680405:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e3bcaba00, rc 0) 00000100:00100000:2.0:1788917073.680566:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f625180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+11:14438:x1875815113539712:12345-192.168.202.40@tcp:101:bash.0 Request processed in 1257us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917073.680575:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:3.0:1788917073.685582:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917073.685682:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113539968 00000100:00100000:1.0:1788917073.685695:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113539968 00000100:00100000:1.0:1788917073.685775:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:1.0:1788917073.685788:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+11:14438:x1875815113539968:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1788917073.685819:0:14264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788917073.685859:0:14264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83ec28 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f9ad expref: -99 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.686026:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3200/0x51de7f756a83ec2f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.686045:0:14264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ec05 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f99f expref: 11 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.686056:0:14264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3200/0x51de7f756a83ec2f lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.686101:0:14264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ec05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f99f expref: 11 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.686119:0:14264:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ec05 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f99f expref: 11 pid: 14265 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917073.686135:0:14264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a80000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14264:1875815140789632:192.168.202.40@tcp:104: 00000100:00100000:1.0:1788917073.686294:0:14264:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e2cf27d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788917073.689614:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917073.689795:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113540096 00000100:00100000:0.0:1788917073.689806:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113540096 00010000:00010000:0.0:1788917073.689855:0:14251:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ec05 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f99f expref: 12 pid: 14265 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917073.689896:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:0.0:1788917073.689906:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f627480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ef94afb-c48b-479f-853f-434eacee288c+12:2373:x1875815113540096:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788917073.689924:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917073.689931:0:14251:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ec05 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f99f expref: 12 pid: 14265 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.689945:0:14251:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ec05 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f99f expref: 12 pid: 14265 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.689973:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:0.0:1788917073.689979:0:14251:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3200/0x51de7f756a83ec2f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.689990:0:14251:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3200/0x51de7f756a83ec2f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.689998:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ec05 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f99f expref: 12 pid: 14265 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917073.689998:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3200/0x51de7f756a83ec2f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917073.690020:0:14264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a80000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14264:1875815140789632:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788917073.690020:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788917073.690061:0:14264:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3200/0x51de7f756a83ec2f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917073.690069:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f627480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ef94afb-c48b-479f-853f-434eacee288c+11:2373:x1875815113540096:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 164us (467us total) trans 0 rc 0/0 00010000:00010000:1.0:1788917073.690071:0:14264:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3200/0x51de7f756a83ec2f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917073.690076:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00010000:00010000:1.0:1788917073.690077:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3200/0x51de7f756a83ec2f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.690102:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83ec36 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.690113:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83ec36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.690121:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83ec36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.690935:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ec3d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.690945:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ec3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.690951:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ec3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788917073.690968:0:14264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788917073.690989:0:14264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3200/0x51de7f756a83ec2f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.690995:0:14264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3200/0x51de7f756a83ec2f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.691000:0:14264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3200/0x51de7f756a83ec2f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.691004:0:14264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d3200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917073.691007:0:14264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3200/0x51de7f756a83ec2f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.691012:0:14264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3200/0x51de7f756a83ec2f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.691019:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:1.0:1788917073.691021:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788917073.691023:0:14264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3200/0x51de7f756a83ec2f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.691027:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3200/0x51de7f756a83ec2f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788917073.691034:0:14264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000097d59f4b reply state 000000002f6786cc transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83ec36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917073.691041:0:14264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788917073.691069:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83ec28 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9ad expref: 14 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.691097:0:14264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ec3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9ad expref: 13 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.691105:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:1.0:1788917073.691107:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788917073.691110:0:14264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1e9d2e00, rc 0) 00000100:00100000:1.0:1788917073.691195:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:14438:x1875815113539968:12345-192.168.202.40@tcp:101:bash.0 Request processed in 5409us (5628us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788917073.691203:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00010000:00010000:2.0:1788917073.692812:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83ec36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.692833:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83ec36 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.692849:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83ec36 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.692855:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d3600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917073.692860:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83ec36 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.692868:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83ec36 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.692882:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6e19456a00) 00010000:00010000:2.0:1788917073.692884:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917073.692888:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83ec36 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.692894:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83ec36 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917073.707955:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917073.708353:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113540224 00000100:00100000:2.0:1788917073.708366:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113540224 00000100:00100000:2.0:1788917073.708443:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:2.0:1788917073.708455:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+13:14438:x1875815113540224:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1788917073.708507:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917073.708543:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ec4b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f9b4 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.708627:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ec52 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.708645:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ec52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.708659:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ec52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917073.708702:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788917073.708707:0:14266:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788917073.708730:0:14266:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ec52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.708740:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ec52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.708778:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ec4b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9b4 expref: 15 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.708802:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ec52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9b4 expref: 14 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.708811:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:2.0:1788917073.708814:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788917073.708818:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f200, rc 0) 00000100:00100000:2.0:1788917073.709028:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f627b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:14438:x1875815113540224:12345-192.168.202.40@tcp:101:bash.0 Request processed in 574us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917073.709036:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:3.0:1788917073.711203:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917073.711243:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113540480 00000100:00100000:2.0:1788917073.711253:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113540480 00000100:00100000:2.0:1788917073.711393:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:2.0:1788917073.711404:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:14438:x1875815113540480:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:2.0:1788917073.711716:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+15:14438:x1875815113540480:12345-192.168.202.40@tcp:35:bash.0 Request processed in 313us (517us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788917073.711724:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:0.0:1788917073.761737:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917073.761891:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113540736 00000100:00100000:1.0:1788917073.761905:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113540736 00000100:00100000:1.0:1788917073.761980:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:1.0:1788917073.761992:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+15:14448:x1875815113540736:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1788917073.762027:0:14264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788917073.762065:0:14264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83ec59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f9bb expref: -99 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788917073.762454:0:14264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788917073.762569:0:14264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83ec59 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9bb expref: 17 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.762584:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:1.0:1788917073.762586:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788917073.762590:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83ec59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9bb expref: 17 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.762622:0:14264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1e9d2800, rc 0) 00000100:00100000:1.0:1788917073.762753:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+16:14448:x1875815113540736:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 764us (1033us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788917073.762769:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:3.0:1788917073.765375:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917073.765602:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113540992 00000100:00100000:1.0:1788917073.765613:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113540992 00000100:00100000:1.0:1788917073.765679:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:1.0:1788917073.765690:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+16:14448:x1875815113540992:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1788917073.766065:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+17:14448:x1875815113540992:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 376us (716us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788917073.766074:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:3.0:1788917073.812418:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917073.812501:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113541248 00000100:00100000:2.0:1788917073.812512:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113541248 00000100:00100000:2.0:1788917073.812587:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:2.0:1788917073.812600:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+17:14451:x1875815113541248:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788917073.812634:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917073.812662:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ec67 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f9c2 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.813210:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ec6e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.813228:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ec6e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.813251:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ec6e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917073.813264:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788917073.813435:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ec67 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9c2 expref: 20 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.813461:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ec6e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9c2 expref: 19 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917073.813470:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:2.0:1788917073.813473:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788917073.813476:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f400, rc 0) 00000100:00100000:2.0:1788917073.813561:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f624380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+19:14451:x1875815113541248:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 962us (1162us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788917073.813570:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:0.0:1788917073.816339:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917073.816451:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113541376 00000100:00100000:1.0:1788917073.816463:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113541376 00000100:00100000:1.0:1788917073.816518:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:1.0:1788917073.816526:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+19:14451:x1875815113541376:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:1.0:1788917073.816592:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83ec7c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.816608:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83ec7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.816617:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83ec7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.816638:0:14264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83ec7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.816660:0:14264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83ec7c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.816665:0:14264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83ec7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.816669:0:14264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d2800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917073.816672:0:14264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83ec7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.816677:0:14264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83ec7c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.816687:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:1.0:1788917073.816689:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788917073.816692:0:14264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83ec7c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917073.816696:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83ec7c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917073.816774:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+19:14451:x1875815113541376:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 247us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917073.816781:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 32 00010000:00010000:3.0:1788917073.823436:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917074.053121:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917074.053290:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113541632 00000100:00100000:2.0:1788917074.053302:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113541632 00000100:00080000:1.0:1788917074.053380:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917074.053419:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:2.0:1788917074.053433:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+19:14488:x1875815113541632:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:2.0:1788917074.053460:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917074.053487:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ec83 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f9c9 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.053599:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ec8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.053614:0:14266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ec3d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9ad expref: 20 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.053622:0:14266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ec52 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9b4 expref: 20 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.053652:0:14266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ec8a lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.053693:0:14266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ec52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9b4 expref: 20 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.053707:0:14266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ec52 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9b4 expref: 20 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917074.053728:0:14266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14266:1875815140789760:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788917074.053880:0:14266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ec3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9ad expref: 20 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.053890:0:14266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ec3d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9ad expref: 20 pid: 14264 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917074.053901:0:14266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14266:1875815140789888:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788917074.053927:0:14266:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e08eef840 going to sleep for 11 seconds 00000100:00100000:2.0:1788917074.059246:0:14266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14266:1875815140789760:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788917074.059267:0:14266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14266:1875815140789888:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788917074.059302:0:14266:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ec8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917074.060028:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917074.063037:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113541760 00000100:00100000:3.0:1788917074.063057:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113541760 00010000:00010000:3.0:1788917074.063119:0:14250:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ec52 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9b4 expref: 21 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917074.063362:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:3.0:1788917074.063373:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d089180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+21:2373:x1875815113541760:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917074.063411:0:14250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917074.063419:0:14250:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ec52 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9b4 expref: 21 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.063432:0:14250:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ec52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9b4 expref: 21 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.063460:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ec52 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9b4 expref: 21 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.063481:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:3.0:1788917074.063487:0:14250:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ec8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.063496:0:14250:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ec8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.063503:0:14250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917074.063671:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d089180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+20:2373:x1875815113541760:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 299us (3646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917074.063681:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:1.0:1788917074.063857:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917074.064104:0:14252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113541888 00000100:00100000:3.0:1788917074.064111:0:14252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113541888 00010000:00010000:3.0:1788917074.064131:0:14252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ec3d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9ad expref: 20 pid: 14264 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917074.064207:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:3.0:1788917074.064215:0:14252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+20:2373:x1875815113541888:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917074.064234:0:14252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917074.064240:0:14252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ec3d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9ad expref: 20 pid: 14264 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.064252:0:14252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ec3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9ad expref: 20 pid: 14264 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.064268:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ec3d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9ad expref: 20 pid: 14264 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.064282:0:14252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:3.0:1788917074.064286:0:14252:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ec8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.064295:0:14252:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ec8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.064304:0:14252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ec8a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.064332:0:14252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917074.064364:0:14252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+19:2373:x1875815113541888:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 151us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917074.064372:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00010000:00010000:3.0:1788917074.064429:0:14266:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ec8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.064438:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ec8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917074.064470:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788917074.064677:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ec83 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9c9 expref: 20 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.064695:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ec8a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9c9 expref: 19 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.064703:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:3.0:1788917074.064706:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788917074.064709:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168ec00, rc 0) 00000100:00100000:3.0:1788917074.064735:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+19:14488:x1875815113541632:12345-192.168.202.40@tcp:101:dd.0 Request processed in 11308us (11631us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788917074.064743:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:1.0:1788917074.069728:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917074.070096:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113542144 00000100:00100000:2.0:1788917074.070111:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113542144 00000100:00100000:2.0:1788917074.070238:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:2.0:1788917074.070251:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+19:14488:x1875815113542144:12345-192.168.202.40@tcp:36:dd.0 00010000:00010000:2.0:1788917074.070602:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ec98 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.070626:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ec98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.070641:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ec98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788917074.070692:0:14264:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934606 00000004:00010000:2.0:1788917074.070720:0:14264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009d275209 reply state 00000000686e8ff3 transno 8589934607 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ec98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917074.070731:0:14264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788917074.071006:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+22:14488:x1875815113542144:12345-192.168.202.40@tcp:36:dd.0 Request processed in 755us (1290us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788917074.071016:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00000020:00080000:2.0:1788917074.071021:0:14264:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788917074.072841:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ec98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.072860:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ec98 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.072868:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ec98 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.072874:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168fc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917074.072878:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ec98 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.072887:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ec98 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.072906:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:0.0:1788917074.072909:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917074.072915:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ec98 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.072922:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ec98 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788917074.079648:0:14298:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788917074.079662:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917074.079727:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1788917074.079829:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788917074.261056:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917074.261232:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113542272 00000100:00100000:3.0:1788917074.261243:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113542272 00000100:00100000:3.0:1788917074.261311:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:3.0:1788917074.261320:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+21:14502:x1875815113542272:12345-192.168.202.40@tcp:101:stat.0 00010000:00010000:3.0:1788917074.261357:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917074.261379:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83ec9f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f9d0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.261440:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eca6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.261453:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eca6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.261481:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eca6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.261494:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83ecad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.261502:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83ecad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.261508:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83ecad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.261621:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ecb4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.261630:0:14266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ec8a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9c9 expref: 22 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.261636:0:14266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ecb4 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.261669:0:14266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ec8a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9c9 expref: 22 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.261680:0:14266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ec8a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9c9 expref: 22 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917074.261692:0:14266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f626a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14266:1875815140790016:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788917074.261802:0:14266:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e0b535000 going to sleep for 11 seconds 00000100:00100000:2.0:1788917074.264534:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917074.264749:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113542528 00000100:00100000:1.0:1788917074.264770:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113542528 00000100:00100000:1.0:1788917074.264836:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:1.0:1788917074.264847:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+23:14275:x1875815113542528:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788917074.265466:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+24:14275:x1875815113542528:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 619us (944us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788917074.265476:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:3.0:1788917074.270554:0:14266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f626a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14266:1875815140790016:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788917074.276090:0:14266:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ecb4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917074.276529:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917074.276745:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113542656 00000100:00100000:3.0:1788917074.276764:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113542656 00010000:00010000:3.0:1788917074.276811:0:14250:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ec8a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9c9 expref: 24 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917074.276860:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:3.0:1788917074.276871:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2ea8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+24:2373:x1875815113542656:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788917074.276891:0:14250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917074.276899:0:14250:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ec8a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9c9 expref: 24 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.276914:0:14250:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ec8a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9c9 expref: 24 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.276942:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ec8a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9c9 expref: 24 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.276964:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:3.0:1788917074.276969:0:14250:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ecb4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.276980:0:14250:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ecb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.276989:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ecb4 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.278465:0:14250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917074.278543:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2ea8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+23:2373:x1875815113542656:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 1668us (2013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917074.278553:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00010000:00010000:2.0:1788917074.280329:0:14266:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ecb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.280758:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ecb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917074.280822:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788917074.280827:0:14266:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788917074.280880:0:14266:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ecb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.280921:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ecb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.280933:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eca6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.280941:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eca6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.280949:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eca6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.280956:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917074.280959:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eca6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.280968:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eca6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.280985:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:2.0:1788917074.280989:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917074.280994:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eca6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.281002:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83eca6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.281022:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83ecad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.281029:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83ecad lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.281041:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83ecad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.281047:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917074.281050:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83ecad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.281056:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83ecad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.281064:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6e02ceed00) 00010000:00010000:2.0:1788917074.281067:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917074.281070:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83ecad lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.281076:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83ecad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.281129:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83ec9f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9d0 expref: 23 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.281344:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ecb4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9d0 expref: 22 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.281362:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:2.0:1788917074.281365:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788917074.281368:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e600, rc 0) 00000100:00100000:2.0:1788917074.281446:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+22:14502:x1875815113542272:12345-192.168.202.40@tcp:101:stat.0 Request processed in 20126us (20404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917074.281464:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:1.0:1788917074.340056:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917074.340270:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113542912 00000100:00100000:2.0:1788917074.340283:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113542912 00000100:00100000:2.0:1788917074.340355:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:2.0:1788917074.340367:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+22:14508:x1875815113542912:12345-192.168.202.40@tcp:36:truncate.0 00010000:00010000:2.0:1788917074.340439:0:14264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917074.340469:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ecb4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9d0 expref: 22 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.340488:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:2.0:1788917074.340493:0:14264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788917074.340736:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ecbb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.340763:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ecbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.340775:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ecbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788917074.340831:0:14264:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788917074.340854:0:14264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000006c39be2 reply state 00000000ff29ece1 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ecbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917074.340864:0:14264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788917074.341038:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+24:14508:x1875815113542912:12345-192.168.202.40@tcp:36:truncate.0 Request processed in 672us (996us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788917074.341046:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 36 00000020:00080000:2.0:1788917074.341069:0:14264:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788917074.351616:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ecbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.351641:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ecbb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.351650:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ecbb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.351657:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168e800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917074.351663:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ecbb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.351671:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ecbb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.351693:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:2.0:1788917074.351696:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917074.351701:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ecbb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.351707:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ecbb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917074.497836:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917074.497962:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113543040 00000100:00100000:2.0:1788917074.497974:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113543040 00000100:00100000:2.0:1788917074.498117:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:2.0:1788917074.498130:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+23:14522:x1875815113543040:12345-192.168.202.40@tcp:101:stat.0 00010000:00010000:2.0:1788917074.498201:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917074.498230:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ecc2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f9d7 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498333:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ecc9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498353:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ecc9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498367:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ecc9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498384:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecd0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498391:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498399:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498523:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ecd7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498532:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ecd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498540:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ecd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917074.498590:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788917074.498595:0:14266:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788917074.498616:0:14266:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ecd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498642:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ecd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498651:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ecc9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498658:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ecc9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498666:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ecc9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498672:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168ec00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917074.498677:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ecc9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498684:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ecc9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498699:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:2.0:1788917074.498702:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917074.498707:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ecc9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498714:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ecc9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498733:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498739:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecd0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498764:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecd0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498770:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168fc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917074.498773:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecd0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498779:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecd0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498788:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6e02f3c400) 00010000:00010000:2.0:1788917074.498790:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917074.498793:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecd0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498799:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecd0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498838:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ecc2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9d7 expref: 25 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498853:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ecd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9d7 expref: 24 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.498861:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:2.0:1788917074.498863:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788917074.498866:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f800, rc 0) 00000100:00100000:2.0:1788917074.498942:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+24:14522:x1875815113543040:12345-192.168.202.40@tcp:101:stat.0 Request processed in 815us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917074.498958:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:0.0:1788917074.555200:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917074.555329:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113543296 00000100:00100000:2.0:1788917074.555340:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113543296 00000100:00100000:2.0:1788917074.555394:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:2.0:1788917074.555402:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+24:14532:x1875815113543296:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788917074.555427:0:14264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917074.555449:0:14264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ecde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f9de expref: -99 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917074.555561:0:14264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788917074.555693:0:14264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ecde lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9de expref: 26 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.555709:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:2.0:1788917074.555713:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788917074.555719:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ecde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9de expref: 26 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.555737:0:14264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168e800, rc 0) 00000100:00100000:2.0:1788917074.555832:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+25:14532:x1875815113543296:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 430us (685us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788917074.555839:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:0.0:1788917074.558000:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917074.558202:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113543552 00000100:00100000:2.0:1788917074.558210:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113543552 00000100:00100000:2.0:1788917074.558424:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:2.0:1788917074.558435:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+25:14532:x1875815113543552:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1788917074.558739:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+26:14532:x1875815113543552:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 305us (749us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788917074.558757:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:1.0:1788917074.604296:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917074.604438:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113543808 00000100:00100000:2.0:1788917074.604449:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113543808 00000100:00100000:2.0:1788917074.604510:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:2.0:1788917074.604518:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+26:14538:x1875815113543808:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1788917074.604547:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917074.604570:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ecec lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f9e5 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.604670:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecf3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.604684:0:14266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ecd7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9d7 expref: 27 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.604703:0:14266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecf3 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.604755:0:14266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ecd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9d7 expref: 27 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.604771:0:14266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ecd7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9d7 expref: 27 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917074.604786:0:14266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14266:1875815140790144:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788917074.604910:0:14266:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e08eef3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788917074.609954:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917074.610089:0:14266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14266:1875815140790144:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788917074.610124:0:14266:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecf3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917074.613261:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113543936 00000100:00100000:1.0:1788917074.613279:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113543936 00010000:00010000:1.0:1788917074.613400:0:14251:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ecd7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9d7 expref: 28 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917074.613465:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:1.0:1788917074.613477:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+28:2374:x1875815113543936:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788917074.613496:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788917074.613505:0:14251:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ecd7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9d7 expref: 28 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917074.613520:0:14251:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ecd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9d7 expref: 28 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917074.613783:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ecd7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9d7 expref: 28 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917074.613810:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:1.0:1788917074.613816:0:14251:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecf3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917074.613827:0:14251:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecf3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917074.613836:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecf3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917074.613878:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788917074.614000:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+27:2374:x1875815113543936:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 524us (4060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917074.614008:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00010000:00010000:2.0:1788917074.614093:0:14266:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecf3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.614104:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecf3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917074.614126:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1788917074.614448:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ecec lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9e5 expref: 28 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.614469:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecf3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9e5 expref: 27 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.614478:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:2.0:1788917074.614481:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788917074.614484:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168fc00, rc 0) 00000100:00100000:2.0:1788917074.614514:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+27:14538:x1875815113543808:12345-192.168.202.40@tcp:101:bash.0 Request processed in 9996us (10233us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788917074.614522:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:0.0:1788917074.628030:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917074.628209:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113544192 00000100:00100000:2.0:1788917074.628222:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113544192 00000100:00100000:2.0:1788917074.628304:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:2.0:1788917074.628315:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+27:14538:x1875815113544192:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:2.0:1788917074.628688:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed01 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.628709:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.628722:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788917074.628823:0:14265:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934614 00000004:00010000:2.0:1788917074.628850:0:14265:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aba88adb reply state 0000000022eb4765 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917074.628861:0:14265:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788917074.628964:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+30:14538:x1875815113544192:12345-192.168.202.40@tcp:36:bash.0 Request processed in 650us (948us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788917074.628972:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 40 00000020:00080000:2.0:1788917074.628977:0:14265:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788917074.632171:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed01 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.632192:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed01 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.632200:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed01 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.632206:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168ec00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917074.632211:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed01 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.632220:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed01 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.632240:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:0.0:1788917074.632243:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917074.632248:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed01 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.632255:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed01 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917074.636142:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917074.636782:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113544320 00000100:00100000:2.0:1788917074.636796:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113544320 00000100:00100000:2.0:1788917074.636869:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:2.0:1788917074.636881:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+29:14538:x1875815113544320:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1788917074.636916:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917074.636946:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed08 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f9ec expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.637041:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed0f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.637059:0:14266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecf3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9e5 expref: 30 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.637084:0:14266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed0f lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.637122:0:14266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecf3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9e5 expref: 30 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.637136:0:14266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecf3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9e5 expref: 30 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917074.637176:0:14266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14266:1875815140790272:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788917074.637273:0:14266:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e09e39540 going to sleep for 11 seconds 00000100:00100000:3.0:1788917074.640115:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917074.640207:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113544448 00000100:00100000:0.0:1788917074.640218:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113544448 00000100:00100000:2.0:1788917074.640259:0:14266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14266:1875815140790272:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788917074.640262:0:14250:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecf3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9e5 expref: 31 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.640286:0:14266:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed0f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917074.640417:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:0.0:1788917074.640428:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f625c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+31:2374:x1875815113544448:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788917074.640460:0:14250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917074.640467:0:14250:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecf3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9e5 expref: 31 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.640481:0:14250:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecf3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9e5 expref: 31 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.640508:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ecf3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9e5 expref: 31 pid: 14266 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.640530:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:0.0:1788917074.640535:0:14250:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed0f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.640545:0:14250:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.640553:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed0f lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.640657:0:14250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788917074.640677:0:14266:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.640684:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917074.640729:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788917074.640734:0:14266:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788917074.640765:0:14266:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917074.640766:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f625c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+30:2374:x1875815113544448:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 339us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917074.640775:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00010000:00010000:2.0:1788917074.640794:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed08 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9ec expref: 30 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.640826:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9ec expref: 29 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.640834:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:2.0:1788917074.640837:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788917074.640840:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f200, rc 0) 00000100:00100000:2.0:1788917074.640867:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+29:14538:x1875815113544320:12345-192.168.202.40@tcp:101:bash.0 Request processed in 3989us (4739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917074.640875:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:1.0:1788917074.644852:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917074.644952:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113544704 00000100:00100000:3.0:1788917074.644964:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113544704 00000100:00100000:3.0:1788917074.645036:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:3.0:1788917074.645048:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+29:14538:x1875815113544704:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:3.0:1788917074.645399:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+30:14538:x1875815113544704:12345-192.168.202.40@tcp:35:bash.0 Request processed in 352us (555us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1788917074.645408:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:1.0:1788917074.703827:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917074.703963:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113544960 00000100:00100000:2.0:1788917074.703977:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113544960 00000100:00100000:2.0:1788917074.704054:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:2.0:1788917074.704066:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+30:14548:x1875815113544960:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788917074.704099:0:14264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917074.704127:0:14264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f9f3 expref: -99 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917074.704303:0:14264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788917074.704446:0:14264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed16 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9f3 expref: 32 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.704466:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:2.0:1788917074.704469:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788917074.704475:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9f3 expref: 32 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.704517:0:14264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168e800, rc 0) 00000100:00100000:2.0:1788917074.704593:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+31:14548:x1875815113544960:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 529us (779us total) trans 8589934617 rc 301/301 00000100:00100000:2.0:1788917074.704601:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:1.0:1788917074.709015:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917074.709867:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113545088 00000100:00100000:2.0:1788917074.709881:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113545088 00000100:00100000:2.0:1788917074.709972:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:2.0:1788917074.709985:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+31:14548:x1875815113545088:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:2.0:1788917074.710078:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed24 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710099:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed24 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710114:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed24 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710133:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed2b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710141:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710170:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710292:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed32 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710324:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710331:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788917074.710377:0:14266:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710388:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed24 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710396:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed24 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710403:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed24 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710411:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168e800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917074.710416:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed24 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710424:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed24 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710439:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:2.0:1788917074.710442:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917074.710448:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed24 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710455:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed24 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710478:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed2b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710485:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed2b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710491:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed2b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710497:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168fc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917074.710500:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed2b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710506:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed2b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710514:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6e02f3c400) 00010000:00010000:2.0:1788917074.710517:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917074.710519:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed2b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710525:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed2b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710543:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710550:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed32 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710557:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710568:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168ec00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917074.710571:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710577:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed32 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710600:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:2.0:1788917074.710602:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917074.710605:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed32 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.710610:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed32 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917074.710711:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+31:14548:x1875815113545088:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 727us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917074.710719:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:1.0:1788917074.715354:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917074.715410:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113545344 00000100:00100000:3.0:1788917074.715421:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113545344 00000100:00100000:3.0:1788917074.715481:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:3.0:1788917074.715493:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edda450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+31:14548:x1875815113545344:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1788917074.715812:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edda450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+32:14548:x1875815113545344:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 320us (466us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1788917074.715821:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:0.0:1788917074.760978:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917074.761108:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113545600 00000100:00100000:2.0:1788917074.761122:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113545600 00000100:00100000:2.0:1788917074.761230:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:2.0:1788917074.761242:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+32:14551:x1875815113545600:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788917074.761273:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917074.761300:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed39 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8f9fa expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761389:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed40 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761423:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed40 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761436:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed40 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761453:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed47 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761461:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761467:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761629:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ed4e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761639:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ed4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761647:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ed4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917074.761657:0:14265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788917074.761776:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed40 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761784:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed40 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761791:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed40 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761803:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168fc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917074.761808:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed40 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761817:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed40 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761831:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:2.0:1788917074.761834:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917074.761840:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed40 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761847:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed40 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761865:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761871:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed47 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761877:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761883:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168e800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917074.761885:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761891:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed47 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761908:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6e02f3c400) 00010000:00010000:2.0:1788917074.761911:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917074.761914:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed47 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761920:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed47 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761963:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed39 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9fa expref: 35 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761977:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ed4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9fa expref: 34 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.761985:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:2.0:1788917074.761987:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788917074.761990:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f800, rc 0) 00000100:00100000:2.0:1788917074.762069:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+34:14551:x1875815113545600:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 829us (1106us total) trans 8589934619 rc 0/0 00000100:00100000:2.0:1788917074.762077:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:1.0:1788917074.768213:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917074.768346:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917074.768406:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113545984 00000100:00100000:3.0:1788917074.768418:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113545984 00000100:00100000:3.0:1788917074.768490:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:3.0:1788917074.768503:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+34:14551:x1875815113545984:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1788917074.768533:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113545728 00000100:00100000:0.0:1788917074.768539:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113545728 00000100:00100000:0.0:1788917074.768630:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:0.0:1788917074.768640:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+35:2374:x1875815113545728:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788917074.768673:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917074.768709:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ed4e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9fa expref: 36 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.768734:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:0.0:1788917074.768740:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788917074.768899:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+35:2374:x1875815113545728:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 260us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917074.768908:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:3.0:1788917074.773254:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+34:14551:x1875815113545984:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 4732us (4887us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788917074.773300:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:1.0:1788917074.776418:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917074.776504:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113546112 00000100:00100000:2.0:1788917074.776519:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113546112 00000100:00100000:3.0:1788917074.776606:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:3.0:1788917074.776621:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+34:14551:x1875815113546112:12345-192.168.202.40@tcp:54:lfs.0 00000100:00100000:2.0:1788917074.776678:0:14264:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788917074.776690:0:14264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00010000:3.0:1788917074.776706:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed5c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.776727:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.776740:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.776786:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.776794:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed5c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.776801:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.776808:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917074.776814:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.776823:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed5c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.776837:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:3.0:1788917074.776840:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788917074.776868:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed5c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917074.776875:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed5c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917074.777248:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+34:14551:x1875815113546112:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 630us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917074.777257:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 45 00010000:00010000:3.0:1788917074.847582:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917074.938637:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917074.938734:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113546240 00000100:00100000:2.0:1788917074.938754:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113546240 00000100:00100000:2.0:1788917074.938812:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:2.0:1788917074.938820:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+34:14570:x1875815113546240:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788917074.938863:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917074.938889:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa01 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.938970:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed6a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.938986:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.938999:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917074.939070:0:14265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788917074.939074:0:14265:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788917074.939097:0:14265:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.939136:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa01 expref: 36 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.939184:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed6a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa01 expref: 35 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.939193:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:2.0:1788917074.939196:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788917074.939200:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168e800, rc 0) 00000100:00100000:2.0:1788917074.939274:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+35:14570:x1875815113546240:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 454us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917074.939282:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:1.0:1788917074.944843:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917074.945215:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113546624 00000100:00100000:2.0:1788917074.945229:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113546624 00000100:00100000:2.0:1788917074.945342:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:2.0:1788917074.945364:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+35:14570:x1875815113546624:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1788917074.945762:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+36:14570:x1875815113546624:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 401us (937us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1788917074.945771:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:1.0:1788917074.948033:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917074.948181:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113546752 00000100:00100000:0.0:1788917074.948193:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113546752 00000100:00100000:0.0:1788917074.948258:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:0.0:1788917074.948270:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+36:14570:x1875815113546752:12345-192.168.202.40@tcp:103:lfs.0 00010000:00010000:0.0:1788917074.948287:0:14250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788917074.948321:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed0f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9ec expref: 36 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.948515:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ec6e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8f9c2 expref: 35 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917074.948529:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e19456100) 00010000:00010000:0.0:1788917074.948542:0:14250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788917074.948611:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+34:14570:x1875815113546752:12345-192.168.202.40@tcp:103:lfs.0 Request processed in 343us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917074.948620:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:1.0:1788917074.950807:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917074.950918:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113546880 00000100:00100000:2.0:1788917074.950930:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113546880 00000100:00100000:2.0:1788917074.950989:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:2.0:1788917074.950997:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+34:14570:x1875815113546880:12345-192.168.202.40@tcp:58:lfs.0 00010000:00010000:2.0:1788917074.951104:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed71 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.951130:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.951140:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788917074.951910:0:14264:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788917074.952009:0:14264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788917074.952100:0:14264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788917074.952256:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+34:14570:x1875815113546880:12345-192.168.202.40@tcp:58:lfs.0 Request processed in 1254us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917074.952268:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:1.0:1788917074.967201:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917074.967367:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113547008 00000100:00100000:2.0:1788917074.967381:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113547008 00000100:00100000:2.0:1788917074.967441:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:2.0:1788917074.967470:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+34:14572:x1875815113547008:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788917074.967499:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917074.967524:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed78 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa08 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.967588:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ed7f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.967604:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ed7f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.967617:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ed7f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.967632:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed86 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.967639:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.967645:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.967776:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ed8d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.967786:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ed8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.967793:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ed8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917074.967842:0:14265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788917074.967847:0:14265:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788917074.967868:0:14265:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ed8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.967937:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ed8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.967950:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ed7f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.967956:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ed7f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.967964:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ed7f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.967971:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917074.967975:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ed7f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.967985:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ed7f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.967997:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:2.0:1788917074.967999:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917074.968003:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ed7f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.968008:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ed7f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.968028:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.968033:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed86 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.968036:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.968039:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917074.968041:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.968044:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed86 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.968048:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6e02f3c100) 00010000:00010000:2.0:1788917074.968049:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917074.968051:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed86 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.968054:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ed86 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.968077:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ed78 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa08 expref: 36 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.968087:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ed8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa08 expref: 35 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917074.968105:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02f3c400) 00010000:00010000:2.0:1788917074.968107:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788917074.968111:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f800, rc 0) 00000100:00100000:2.0:1788917074.968322:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+35:14572:x1875815113547008:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 853us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917074.968327:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 48 00000040:00080000:1.0:1788917075.103364:0:14298:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:1.0:1788917075.103378:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917075.103782:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788917075.103807:0:14298:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00000040:00080000:1.0:1788917075.103836:0:14298:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917075.103886:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917075.103889:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917075.103919:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788917075.103924:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917075.104284:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14298:1875815140790400:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788917075.104629:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e2cf27180 going to sleep for 11 seconds 00000100:00100000:0.0:1788917075.109877:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14298:1875815140790400:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788917075.110724:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917075.110821:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113547136 00000100:00100000:0.0:1788917075.110830:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113547136 00000100:00100000:0.0:1788917075.110894:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:0.0:1788917075.110905:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:92610db9-d8ec-4111-b657-7a2541e0ec4f+35:14583:x1875815113547136:12345-192.168.202.40@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788917075.111000:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:92610db9-d8ec-4111-b657-7a2541e0ec4f+35:14583:x1875815113547136:12345-192.168.202.40@tcp:900:lhsmtool_posix.0 Request processed in 95us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917075.111009:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:1.0:1788917075.117073:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917075.117189:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113547264 00000100:00100000:0.0:1788917075.117203:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113547264 00000100:00100000:0.0:1788917075.117267:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:0.0:1788917075.117278:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+35:14583:x1875815113547264:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788917075.117321:0:16396:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788917075.117470:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+35:14583:x1875815113547264:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 193us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917075.117479:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:0.0:1788917075.119846:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917075.119915:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113547392 00000100:00100000:3.0:1788917075.119925:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113547392 00000100:00100000:3.0:1788917075.119984:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:3.0:1788917075.119995:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+35:14583:x1875815113547392:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788917075.120076:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed94 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120098:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed94 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120114:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed94 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120335:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ed9b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120358:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ed9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120370:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ed9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120702:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83eda2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120712:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83eda2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120720:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83eda2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917075.120783:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788917075.120788:0:14266:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788917075.120807:0:14266:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83eda2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120819:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed94 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120826:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed94 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120833:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed94 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120840:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917075.120844:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed94 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120852:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed94 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120864:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6e02f3c500) 00010000:00010000:3.0:1788917075.120872:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917075.120878:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed94 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120882:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ed94 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120901:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ed9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120904:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ed9b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120908:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ed9b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120911:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18fa00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917075.120913:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ed9b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120916:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ed9b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120921:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9a6e02ceec00) 00010000:00010000:3.0:1788917075.120922:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917075.120923:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ed9b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120926:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ed9b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120936:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83eda2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120944:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83eda2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120950:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83eda2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120955:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917075.120957:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83eda2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120963:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83eda2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120970:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02f3c400) 00010000:00010000:3.0:1788917075.120972:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917075.120975:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83eda2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.120981:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83eda2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917075.121442:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+35:14583:x1875815113547392:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 Request processed in 1446us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917075.121451:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:3.0:1788917075.125106:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917075.125321:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113547648 00000100:00100000:0.0:1788917075.125334:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113547648 00000100:00100000:0.0:1788917075.125407:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:0.0:1788917075.125419:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+35:14583:x1875815113547648:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788917075.125448:0:16396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917075.125476:0:16396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83eda9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa0f expref: -99 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.125588:0:16396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edb0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.125613:0:16396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.125626:0:16396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917075.125639:0:16396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788917075.125776:0:16396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.125784:0:16396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edb0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.125792:0:16396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edb0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.125798:0:16396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcab600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917075.125802:0:16396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edb0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.125812:0:16396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edb0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.125827:0:16396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02f3c400) 00010000:00010000:0.0:1788917075.125831:0:16396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788917075.125904:0:16396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edb0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.125912:0:16396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edb0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.125959:0:16396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83eda9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa0f expref: 37 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.125978:0:16396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6e02f3c500) 00010000:00010000:0.0:1788917075.125981:0:16396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788917075.125985:0:16396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83eda9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa0f expref: 37 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.125995:0:16396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e3bcaae00, rc 0) 00000100:00100000:0.0:1788917075.126302:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f624000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+36:14583:x1875815113547648:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 884us (1208us total) trans 8589934622 rc 301/301 00000100:00100000:0.0:1788917075.126311:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:1.0:1788917075.129705:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917075.131009:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113547776 00000100:00100000:0.0:1788917075.131022:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113547776 00000100:00100000:0.0:1788917075.131208:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:0.0:1788917075.131221:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+36:14583:x1875815113547776:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788917075.131266:0:14265:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788917075.131413:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+36:14583:x1875815113547776:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 195us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917075.131422:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:2.0:1788917075.136465:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917075.136519:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113548032 00000100:00100000:3.0:1788917075.136531:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113548032 00000100:00100000:3.0:1788917075.136599:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:3.0:1788917075.136611:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+36:14583:x1875815113548032:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788917075.136654:0:14264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917075.136659:0:14264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788917075.136695:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ed6a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa01 expref: 36 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.136716:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:3.0:1788917075.136722:0:14264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788917075.136737:0:14264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83edbe lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa16 expref: -99 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788917075.137528:0:14264:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:3.0:1788917075.137535:0:14264:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1788917075.137590:0:14264:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:3.0:1788917075.137859:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83edc5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.137876:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83edc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.137886:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83edc5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.138070:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83edbe lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa16 expref: 38 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.138085:0:14264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83edc5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa16 expref: 37 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.138091:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6e02ceec00) 00010000:00010000:3.0:1788917075.138098:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788917075.138101:0:14264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18fa00, rc 0) 00000100:00100000:3.0:1788917075.138181:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+37:14583:x1875815113548032:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 1572us (1726us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788917075.138189:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:1.0:1788917075.141019:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917075.141203:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113548288 00000100:00100000:3.0:1788917075.141215:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113548288 00000100:00100000:1.0:1788917075.141346:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:1.0:1788917075.141358:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+37:14583:x1875815113548288:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788917075.141422:0:14266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788917075.141451:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83edc5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa16 expref: 37 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141471:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6e02ceec00) 00010000:00010000:1.0:1788917075.141482:0:14266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788917075.141507:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83edd3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141521:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83edd3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141551:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83edd3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141568:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3400/0x51de7f756a83edda lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb5a3fd2d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141574:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3400/0x51de7f756a83edda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb5a3fd2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141581:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3400/0x51de7f756a83edda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb5a3fd2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141666:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83edd3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141674:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83edd3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141682:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83edd3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141687:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d2e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917075.141691:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83edd3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141699:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83edd3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141707:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:1.0:1788917075.141710:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788917075.141714:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83edd3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141727:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83edd3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141738:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3400/0x51de7f756a83edda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb5a3fd2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141753:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3400/0x51de7f756a83edda lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb5a3fd2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141760:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3400/0x51de7f756a83edda lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb5a3fd2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141766:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d3400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917075.141770:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3400/0x51de7f756a83edda lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb5a3fd2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141776:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3400/0x51de7f756a83edda lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb5a3fd2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141784:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xb5a3fd2d (ffff9a6e19456f00) 00010000:00010000:1.0:1788917075.141787:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788917075.141789:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3400/0x51de7f756a83edda lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb5a3fd2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.141796:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3400/0x51de7f756a83edda lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb5a3fd2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917075.141890:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+36:14583:x1875815113548288:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 526us (871us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788917075.141898:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:1.0:1788917075.143854:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917075.143992:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113548416 00000100:00100000:3.0:1788917075.144000:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113548416 00000100:00100000:3.0:1788917075.144046:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:3.0:1788917075.144056:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+36:14583:x1875815113548416:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788917075.144078:0:14264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917075.144105:0:14264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ede1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa1d expref: -99 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.144142:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ede8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.144264:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ede8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.144275:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ede8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.144373:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ede1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa1d expref: 38 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.144396:0:14264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ede8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa1d expref: 37 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.144418:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:3.0:1788917075.144421:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788917075.144424:0:14264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e000, rc 0) 00000100:00100000:3.0:1788917075.144508:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+37:14583:x1875815113548416:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 453us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917075.144517:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:2.0:1788917075.146109:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917075.146256:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113548672 00000100:00100000:0.0:1788917075.146265:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113548672 00000100:00100000:0.0:1788917075.146316:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:0.0:1788917075.146326:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+37:14583:x1875815113548672:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788917075.146403:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.146419:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.146440:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788917075.146908:0:14265:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1788917075.146918:0:14265:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 471178771412ns, next at 472178768669ns, rc = 0 00000004:00010000:0.0:1788917075.147013:0:14265:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075690696 reply state 00000000941343a6 transno 8589934624 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917075.147022:0:14265:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788917075.147124:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+39:14583:x1875815113548672:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 799us (1020us total) trans 8589934624 rc 0/0 00000100:00100000:0.0:1788917075.147132:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00010000:00010000:2.0:1788917075.153346:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.153369:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edef lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.153377:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.153383:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcab600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917075.153388:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.153396:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edef lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.153416:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:2.0:1788917075.153419:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788917075.153425:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edef lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.153453:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83edef lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917075.153951:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917075.154187:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113548800 00000100:00100000:3.0:1788917075.154202:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113548800 00000100:00100000:2.0:1788917075.154300:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:2.0:1788917075.154310:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+38:14583:x1875815113548800:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788917075.154342:0:14264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917075.154364:0:14264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83edf6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa24 expref: -99 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.154424:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83edf6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa24 expref: 39 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.154436:0:14264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83edf6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa24 expref: 39 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.154453:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:2.0:1788917075.154456:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788917075.154458:0:14264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f200, rc 0) 00000100:00100000:2.0:1788917075.154519:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+39:14583:x1875815113548800:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 210us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917075.154527:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:1.0:1788917075.161260:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917075.161480:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113548928 00000100:00100000:0.0:1788917075.161492:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113548928 00000100:00100000:0.0:1788917075.161579:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:0.0:1788917075.161590:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+5:2373:x1875815113548928:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788917075.162031:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2373:x1875815113548928:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 441us (786us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788917075.162040:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00080000:1.0:1788917075.162117:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788917075.164908:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917075.165187:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113549184 00000100:00100000:1.0:1788917075.165200:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113549184 00000100:00100000:1.0:1788917075.168875:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:1.0:1788917075.168910:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+39:14583:x1875815113549184:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788917075.169249:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+40:14583:x1875815113549184:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 358us (4353us total) trans 8589934625 rc 0/0 00000100:00100000:1.0:1788917075.169258:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:3.0:1788917075.171830:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917075.172581:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113549440 00000100:00100000:1.0:1788917075.172594:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113549440 00000100:00100000:1.0:1788917075.172673:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:1.0:1788917075.172685:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+40:14583:x1875815113549440:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788917075.172832:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f627100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+40:14583:x1875815113549440:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 148us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917075.172840:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:3.0:1788917075.175315:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917075.175386:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113549568 00000100:00100000:2.0:1788917075.175396:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113549568 00000100:00100000:2.0:1788917075.175455:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:2.0:1788917075.175465:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+40:14583:x1875815113549568:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788917075.175510:0:14264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917075.175535:0:14264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83edfd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa2b expref: -99 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.175610:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ee04 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.175627:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ee04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.175640:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ee04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917075.175681:0:14264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788917075.175702:0:14264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ee04 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.175729:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83edfd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa2b expref: 42 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.175766:0:14264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ee04 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa2b expref: 41 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.175776:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:2.0:1788917075.175780:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788917075.175783:0:14264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168e800, rc 0) 00000100:00100000:2.0:1788917075.175852:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f627480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+41:14583:x1875815113549568:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 388us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917075.175860:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:3.0:1788917075.178959:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917075.179038:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113549696 00000100:00100000:2.0:1788917075.179049:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113549696 00000100:00100000:2.0:1788917075.179116:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:2.0:1788917075.179127:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2373:x1875815113549696:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788917075.179170:0:14901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917075.179195:0:14901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83ee0b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa32 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788917075.179230:0:14901:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0b552, blocks: 0x1 00010000:00010000:2.0:1788917075.179257:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=471s v=(0 0) 00010000:00010000:2.0:1788917075.179264:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788917075.179277:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83ee0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa32 expref: 7 pid: 14901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.179302:0:14901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83ee0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa32 expref: 7 pid: 14901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.179319:0:14901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168fc00, rc 0) 00000100:00100000:2.0:1788917075.179390:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:2373:x1875815113549696:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 264us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917075.179398:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:2.0:1788917075.182315:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917075.182417:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113549952 00000100:00100000:1.0:1788917075.182429:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113549952 00000100:00100000:1.0:1788917075.182503:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:1.0:1788917075.182516:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+41:14583:x1875815113549952:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788917075.182631:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+41:14583:x1875815113549952:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 118us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917075.182640:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:2.0:1788917075.188387:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917075.188459:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113550080 00000100:00100000:0.0:1788917075.188470:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113550080 00000100:00100000:0.0:1788917075.188566:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:0.0:1788917075.188576:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:14583:x1875815113550080:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788917075.188599:0:14903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917075.188623:0:14903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa08d280/0x51de7f756a83ee12 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa39 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.188678:0:14903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83ee0b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa32 expref: 8 pid: 14901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.188685:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788917075.188689:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788917075.188693:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa08d280/0x51de7f756a83ee12 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa39 expref: 8 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.188729:0:14903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83ee0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa32 expref: 8 pid: 14901 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.188740:0:14903:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83ee0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa32 expref: 8 pid: 14901 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917075.188773:0:14903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d089880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14903:1875815140790528:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917075.188876:0:14903:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e1fd31b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788917075.193764:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917075.194074:0:14903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d089880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14903:1875815140790528:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788917075.194122:0:14903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fa08d280/0x51de7f756a83ee12 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa39 expref: 8 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.194178:0:14903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e3bcab200, rc 0) 00000100:00100000:1.0:1788917075.194199:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113550208 00000100:00100000:1.0:1788917075.194208:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113550208 00000100:00100000:0.0:1788917075.194240:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+9:14583:x1875815113550080:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 5664us (5868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917075.194250:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00010000:00010000:1.0:1788917075.194270:0:14251:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83ee0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa32 expref: 9 pid: 14901 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917075.194330:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:0.0:1788917075.194336:0:14252:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788917075.194342:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+8:2374:x1875815113550208:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788917075.194360:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788917075.194385:0:14251:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83ee0b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa32 expref: 8 pid: 14901 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.194399:0:14251:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83ee0b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa32 expref: 8 pid: 14901 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.194429:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83ee0b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa32 expref: 8 pid: 14901 timeout: 571 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.194446:0:14251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917075.194451:0:14251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917075.194476:0:14251:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa08d280/0x51de7f756a83ee12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa39 expref: 7 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.194490:0:14251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa08d280/0x51de7f756a83ee12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa39 expref: 7 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.194531:0:14251:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fa08d280/0x51de7f756a83ee12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa39 expref: 7 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917075.194561:0:14251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14251:1875815140790656:192.168.202.40@tcp:105: 00000100:00100000:1.0:1788917075.194624:0:14251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e2cf27240 going to sleep for 11 seconds 00000100:00100000:0.0:1788917075.194774:0:14252:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788917075.203821:0:14251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14251:1875815140790656:192.168.202.40@tcp:105: 00000100:00100000:3.0:1788917075.204123:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917075.204270:0:14906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113550336 00000100:00100000:2.0:1788917075.204281:0:14906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113550336 00002000:00100000:2.0:1788917075.204335:0:14906:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff9a6e3f625500 x1875815113550336/t0(0) o4->92610db9-d8ec-4111-b657-7a2541e0ec4f@192.168.202.40@tcp:456/0 lens 504/0 e 0 to 0 dl 1788917086 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788917075.204362:0:14906:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e3f625500 with x1875815113550336 ext(0->8) 00002000:00010000:2.0:1788917075.204367:0:14906:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6e3f625500 00000100:00100000:2.0:1788917075.204398:0:14906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:2.0:1788917075.204406:0:14906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+8:2374:x1875815113550336:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 00010000:00010000:0.0:1788917075.204838:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788917075.204902:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+10:2374:x1875815113550208:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 10562us (11166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917075.204912:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:2.0:1788917075.205720:0:14906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f625500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+9:2374:x1875815113550336:12345-192.168.202.40@tcp:4:lhsmtool_posix.0 Request processed in 1311us (1597us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788917075.205729:0:14906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00002000:00100000:2.0:1788917075.205738:0:14906:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff9a6e3f625500 x1875815113550336/t8589934596(0) o4->92610db9-d8ec-4111-b657-7a2541e0ec4f@192.168.202.40@tcp:456/0 lens 504/448 e 0 to 0 dl 1788917086 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788917075.205760:0:14906:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e3f625500 with x1875815113550336 ext(0->8) 00002000:00010000:2.0:1788917075.205765:0:14906:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6e3f625500 00000100:00100000:2.0:1788917075.208123:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917075.208181:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113550464 00000100:00100000:3.0:1788917075.208193:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113550464 00000100:00100000:3.0:1788917075.208246:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:3.0:1788917075.208253:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+41:14583:x1875815113550464:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788917075.239596:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934624 is committed 00000004:00080000:0.0:1788917075.239612:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788917075.239631:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1788917075.239639:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934625 is committed 00000001:00080000:0.0:1788917075.239704:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1788917075.239723:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+17:14583:x1875815113550464:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 Request processed in 31460us (31667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917075.239738:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:0.0:1788917075.239894:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140790784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788917075.239964:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917075.240020:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140790784 00000100:00100000:0.0:1788917075.240028:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140790784 00000100:00100000:0.0:1788917075.240083:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788917075.240092:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140790784:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788917075.240283:0:16200:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788917075.240287:0:16200:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788917074 00002000:00010000:0.0:1788917075.240289:0:16200:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788917075.240291:0:16200:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788917074 -> 1788917074 00002000:00010000:0.0:1788917075.240294:0:16200:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788917075.240335:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875815140790784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 244us (371us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788917075.240348:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788917075.240372:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788917075.240426:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788917075.240447:0:3306:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9a6e2d089880 x1875815140790784/t8589934597(8589934597) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788917091 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788917075.240460:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6e2d089880/2, rc 0, transno 8589934597 00000100:00100000:1.0:1788917075.240466:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140790784:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788917075.245111:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917075.245264:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113550592 00000100:00100000:0.0:1788917075.245288:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113550592 00000100:00100000:0.0:1788917075.245371:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:0.0:1788917075.245380:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+9:2373:x1875815113550592:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788917075.279960:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+9:2373:x1875815113550592:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 Request processed in 34569us (34851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917075.279977:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000001:00080000:0.0:1788917075.280023:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:0.0:1788917075.280033:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:0.0:1788917075.280038:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000100:00100000:1.0:1788917075.284113:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917075.284353:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113550848 00000100:00100000:3.0:1788917075.284364:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113550848 00000100:00100000:3.0:1788917075.284428:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:3.0:1788917075.284442:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+13:14583:x1875815113550848:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788917075.284506:0:14266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788917075.284542:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ee04 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa2b expref: 13 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.284580:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:3.0:1788917075.284585:0:14266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788917075.284619:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ee19 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.284636:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ee19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.284648:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ee19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788917075.284903:0:14266:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000075703b13 reply state 00000000550a1892 transno 8589934626 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ee19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917075.284914:0:14266:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788917075.285041:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:14583:x1875815113550848:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 601us (936us total) trans 8589934626 rc 0/0 00000100:00100000:3.0:1788917075.285050:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00010000:00010000:0.0:1788917075.287214:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ee19 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.287231:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ee19 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.287239:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ee19 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.287245:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917075.287249:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ee19 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.287257:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ee19 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.287273:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:0.0:1788917075.287276:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917075.287281:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ee19 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.287287:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ee19 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917075.291320:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917075.291663:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113550976 00000100:00100000:3.0:1788917075.291675:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113550976 00000100:00100000:3.0:1788917075.294522:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:3.0:1788917075.294543:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2371:x1875815113550976:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788917075.295586:0:16200:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788917075.295591:0:16200:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788917074 -> 1788917073 00002000:00010000:3.0:1788917075.295594:0:16200:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788917072 00002000:00010000:3.0:1788917075.295596:0:16200:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788917074 -> 1788917073 00002000:00010000:3.0:1788917075.295599:0:16200:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788917075.295711:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:2371:x1875815113550976:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 1171us (4400us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788917075.295721:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:3.0:1788917075.300772:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917075.300828:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113551232 00000100:00100000:0.0:1788917075.300840:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113551232 00000100:00100000:0.0:1788917075.300945:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:0.0:1788917075.300959:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+13:14583:x1875815113551232:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788917075.301040:0:16396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab000/0x51de7f756a83ee20 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.301074:0:16396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ede8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa1d expref: 13 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.301085:0:16396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab000/0x51de7f756a83ee20 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.301133:0:16396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ede8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa1d expref: 13 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.301184:0:16396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ede8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa1d expref: 13 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917075.301203:0:16396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d089500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16396:1875815140790912:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917075.301316:0:16396:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36436240 going to sleep for 11 seconds 00000100:00100000:3.0:1788917075.305967:0:16396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d089500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16396:1875815140790912:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917075.305990:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1788917075.306007:0:16396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab000/0x51de7f756a83ee20 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917075.306034:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113551360 00000100:00100000:0.0:1788917075.306043:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113551360 00010000:00010000:0.0:1788917075.306087:0:14250:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ede8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa1d expref: 14 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917075.306166:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:0.0:1788917075.306179:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2374:x1875815113551360:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788917075.306197:0:14250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917075.306205:0:14250:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ede8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa1d expref: 14 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.306218:0:14250:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ede8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa1d expref: 14 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.306247:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ede8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa1d expref: 14 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.306264:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:0.0:1788917075.306269:0:14250:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab000/0x51de7f756a83ee20 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.306280:0:14250:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab000/0x51de7f756a83ee20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.306289:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab000/0x51de7f756a83ee20 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.306316:0:14250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788917075.306369:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+13:2374:x1875815113551360:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 193us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917075.306377:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00010000:00010000:0.0:1788917075.306455:0:16396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab000/0x51de7f756a83ee20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.306468:0:16396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab000/0x51de7f756a83ee20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.306501:0:16396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab000/0x51de7f756a83ee20 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.306510:0:16396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab000/0x51de7f756a83ee20 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.306517:0:16396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab000/0x51de7f756a83ee20 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.306524:0:16396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcab000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917075.306527:0:16396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab000/0x51de7f756a83ee20 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.306533:0:16396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab000/0x51de7f756a83ee20 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.306540:0:16396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:0.0:1788917075.306542:0:16396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788917075.306545:0:16396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab000/0x51de7f756a83ee20 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.306550:0:16396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab000/0x51de7f756a83ee20 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917075.306586:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f625f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+12:14583:x1875815113551232:12345-192.168.202.40@tcp:55:lhsmtool_posix.0 Request processed in 5632us (5823us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788917075.306592:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:0.0:1788917075.311722:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917075.311821:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113551488 00000100:00100000:1.0:1788917075.311833:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113551488 00000100:00100000:1.0:1788917075.311930:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:1.0:1788917075.311942:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:2371:x1875815113551488:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788917075.312003:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000bae914a/0x51de7f756a83ee27 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.312029:0:14903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa08d280/0x51de7f756a83ee12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa39 expref: 7 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.312040:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917075.312045:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788917075.312057:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bae914a/0x51de7f756a83ee27 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.312106:0:14903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa08d280/0x51de7f756a83ee12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa39 expref: 7 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.312122:0:14903:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa08d280/0x51de7f756a83ee12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa39 expref: 7 pid: 14903 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917075.312139:0:14903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14903:1875815140791040:192.168.202.40@tcp:104: 00000100:00100000:1.0:1788917075.312255:0:14903:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e2cf27780 going to sleep for 11 seconds 00000100:00100000:1.0:1788917075.316964:0:14903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14903:1875815140791040:192.168.202.40@tcp:104: 00010000:00010000:1.0:1788917075.317004:0:14903:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000bae914a/0x51de7f756a83ee27 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917075.321929:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917075.322249:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113551616 00000100:00100000:3.0:1788917075.322263:0:16404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113551616 00010000:00010000:0.0:1788917075.322821:0:16404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa08d280/0x51de7f756a83ee12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa39 expref: 8 pid: 14903 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917075.322882:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:0.0:1788917075.322893:0:16404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2ea8d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+8:2374:x1875815113551616:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788917075.322914:0:16404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917075.322943:0:16404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa08d280/0x51de7f756a83ee12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa39 expref: 8 pid: 14903 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.322959:0:16404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa08d280/0x51de7f756a83ee12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa39 expref: 8 pid: 14903 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.322993:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa08d280/0x51de7f756a83ee12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa39 expref: 8 pid: 14903 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.323013:0:16404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788917075.323019:0:16404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788917075.323025:0:16404:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000bae914a/0x51de7f756a83ee27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.323038:0:16404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bae914a/0x51de7f756a83ee27 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.323076:0:16404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788917075.326230:0:14903:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000bae914a/0x51de7f756a83ee27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.326256:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bae914a/0x51de7f756a83ee27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.326302:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000bae914a/0x51de7f756a83ee27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.326313:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bae914a/0x51de7f756a83ee27 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.326323:0:14903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bae914a/0x51de7f756a83ee27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.326332:0:14903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d3e00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917075.326337:0:14903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bae914a/0x51de7f756a83ee27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.326364:0:14903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bae914a/0x51de7f756a83ee27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.326391:0:14903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bae914a/0x51de7f756a83ee27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.326400:0:14903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bae914a/0x51de7f756a83ee27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917075.326532:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:2371:x1875815113551488:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 Request processed in 14575us (14808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917075.326545:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:0.0:1788917075.326805:0:16404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2ea8d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113551616:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 3910us (4888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917075.326817:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:0.0:1788917075.329833:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917075.332856:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113551872 00000100:00100000:1.0:1788917075.332877:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113551872 00000100:00100000:1.0:1788917075.332960:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:1.0:1788917075.332969:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+12:14583:x1875815113551872:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788917075.333066:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2a00/0x51de7f756a83ee2e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.333093:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2a00/0x51de7f756a83ee2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.333106:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2a00/0x51de7f756a83ee2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.333456:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ee35 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.333469:0:14265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83edf6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa24 expref: 13 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.333477:0:14265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ee35 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.333523:0:14265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83edf6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa24 expref: 13 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.333538:0:14265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83edf6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa24 expref: 13 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917075.333555:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14265:1875815140791168:192.168.202.40@tcp:104: 00000100:00100000:1.0:1788917075.333669:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06e45540 going to sleep for 11 seconds 00000100:00100000:0.0:1788917075.338585:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917075.338625:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113552000 00000100:00100000:0.0:1788917075.338634:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113552000 00010000:00010000:0.0:1788917075.338680:0:14250:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83edf6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa24 expref: 14 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917075.338686:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14265:1875815140791168:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788917075.338715:0:14265:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ee35 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917075.338719:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:0.0:1788917075.338729:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2374:x1875815113552000:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788917075.338759:0:14250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917075.338767:0:14250:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83edf6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa24 expref: 14 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.338780:0:14250:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83edf6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa24 expref: 14 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.338807:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83edf6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa24 expref: 14 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.338825:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:0.0:1788917075.338830:0:14250:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ee35 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.338841:0:14250:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ee35 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.338859:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ee35 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.338900:0:14250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788917075.338912:0:14265:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ee35 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.338919:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ee35 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917075.338958:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+13:2374:x1875815113552000:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 229us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917075.338966:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000001:00080000:2.0:1788917075.339225:0:14265:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000001:00080000:2.0:1788917075.339393:0:14265:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934628 00000001:00080000:2.0:1788917075.339452:0:14265:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:2.0:1788917075.339544:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14265:1875815140791296:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788917075.339639:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917075.339670:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788917075.339708:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140791296 00000100:00100000:0.0:1788917075.339714:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140791296 00000100:00100000:0.0:1788917075.339764:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788917075.339771:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14265:x1875815140791296:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788917075.339844:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14265:x1875815140791296:12345-0@lo:1000:mdt00_001.0 Request processed in 74us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917075.339850:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788917075.339877:0:14265:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1788917075.339941:0:14265:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6e2d089880, transno 8589934597 00000100:00100000:0.0:1788917075.339954:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14265:1875815140791296:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788917075.340831:0:14265:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00000100:00100000:0.0:1788917075.341801:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d089c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14265:1875815140791424:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788917075.341879:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917075.342025:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e364369c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788917075.342608:0:14269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140791424 00000100:00100000:1.0:1788917075.342617:0:14269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140791424 00000100:00100000:1.0:1788917075.342671:0:14269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788917075.342681:0:14269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14265:x1875815140791424:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788917075.342928:0:14269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14265:x1875815140791424:12345-0@lo:1000:mdt00_001.0 Request processed in 248us (1047us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788917075.342937:0:14269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788917075.343050:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d089c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14265:1875815140791424:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788917075.343105:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ee35 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.343117:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ee35 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.343132:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ee35 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.343138:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d2e00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917075.343142:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ee35 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.343172:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ee35 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.343191:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6e02cee200) 00010000:00010000:0.0:1788917075.343194:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788917075.343199:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ee35 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.343207:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2e00/0x51de7f756a83ee35 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.343248:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.343254:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed71 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.343259:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed71 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.343263:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168ec00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917075.343266:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed71 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.343280:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed71 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.343290:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02f3c400) 00010000:00010000:0.0:1788917075.343293:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788917075.343295:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed71 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.343301:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ed71 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.343328:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee3c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.343472:0:14265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ed8d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa08 expref: 16 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.343483:0:14265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee3c lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.343519:0:14265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ed8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa08 expref: 16 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.343535:0:14265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ed8d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa08 expref: 16 pid: 14265 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917075.343548:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d089500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14265:1875815140791552:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917075.343621:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e364369c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788917075.347430:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d089500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14265:1875815140791552:192.168.202.40@tcp:104: 00010000:00010000:1.0:1788917075.347470:0:14265:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee3c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917075.350008:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917075.350214:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113552128 00000100:00100000:0.0:1788917075.350232:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113552128 00010000:00010000:0.0:1788917075.350277:0:14251:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ed8d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa08 expref: 17 pid: 14265 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917075.350326:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:0.0:1788917075.350337:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+17:2373:x1875815113552128:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788917075.350357:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917075.350365:0:14251:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ed8d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa08 expref: 17 pid: 14265 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350381:0:14251:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ed8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa08 expref: 17 pid: 14265 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350410:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ed8d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa08 expref: 17 pid: 14265 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350429:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02f3c400) 00010000:00010000:0.0:1788917075.350436:0:14251:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee3c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350448:0:14251:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee3c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350457:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee3c lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.350558:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788917075.350623:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+16:2373:x1875815113552128:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 286us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917075.350636:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00010000:00010000:0.0:1788917075.350689:0:14265:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee3c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350699:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee3c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350719:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee3c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350727:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee3c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350734:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee3c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350752:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcab200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917075.350757:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee3c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350766:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee3c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350775:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02f3c400) 00010000:00010000:0.0:1788917075.350779:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917075.350783:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee3c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350789:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee3c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350800:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2a00/0x51de7f756a83ee2e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350807:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2a00/0x51de7f756a83ee2e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350813:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2a00/0x51de7f756a83ee2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350825:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d2a00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917075.350829:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2a00/0x51de7f756a83ee2e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350835:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2a00/0x51de7f756a83ee2e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350845:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02f3c400) 00010000:00010000:0.0:1788917075.350847:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788917075.350850:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2a00/0x51de7f756a83ee2e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.350856:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2a00/0x51de7f756a83ee2e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917075.351200:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+15:14583:x1875815113551872:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 18230us (21375us total) trans 8589934631 rc 0/0 00000100:00100000:0.0:1788917075.351210:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00000020:00080000:0.0:1788917075.351214:0:14265:0:(tgt_main.c:816:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788917075.351455:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917075.351461:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917075.351509:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788917075.351517:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917075.354290:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917075.354347:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113552384 00000100:00100000:2.0:1788917075.354359:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113552384 00000100:00100000:2.0:1788917075.354419:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:2.0:1788917075.354430:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+15:14583:x1875815113552384:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788917075.355136:0:14268:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788917075.355286:0:14268:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00010000:00010000:2.0:1788917075.355327:0:14268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ee43 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.355343:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ee43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.355355:0:14268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ee43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.355364:0:14268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ee43 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.355371:0:14268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ee43 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.355377:0:14268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ee43 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.355403:0:14268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788917075.355493:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+17:14583:x1875815113552384:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 1063us (1208us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1788917075.355502:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000020:00080000:2.0:1788917075.355507:0:14268:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788917075.355669:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788917075.355678:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ee43 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.355686:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168e800 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917075.355691:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ee43 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.355758:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ee43 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.355774:0:14254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6e02f3cb00) 00010000:00010000:3.0:1788917075.355778:0:14254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788917075.355784:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ee43 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.355801:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ee43 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.355822:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917075.355824:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917075.355826:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917075.487397:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140791680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917075.487497:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917075.487542:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140791680 00000100:00100000:3.0:1788917075.487552:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140791680 00000100:00100000:0.0:1788917075.487565:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140792192:0@lo:400:kworker.0 00000100:00100000:0.0:1788917075.487593:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917075.487619:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788917075.487620:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788917075.487625:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140792064:0@lo:400:kworker.0 00000100:00100000:3.0:1788917075.487632:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140791680:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917075.487661:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788917075.487664:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788917075.487700:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140791808:0@lo:400:kworker.0 00000100:00100000:3.0:1788917075.487719:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140791680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917075.487728:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788917075.487759:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917075.487785:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140791808 00000100:00100000:3.0:1788917075.487789:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140791808 00000100:00100000:0.0:1788917075.487790:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140792320:0@lo:400:kworker.0 00000100:00100000:3.0:1788917075.487827:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788917075.487831:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917075.487834:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140791808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917075.487852:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788917075.487858:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140791936:0@lo:400:kworker.0 00000100:00100000:3.0:1788917075.487866:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140791808:12345-0@lo:400:kworker.0 Request processed in 33us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917075.487871:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788917075.487893:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917075.487903:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140792192 00000100:00100000:3.0:1788917075.487906:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140792192 00000100:00100000:0.0:1788917075.487932:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140791808:0@lo:400:kworker.0 00000100:00100000:3.0:1788917075.487942:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140792064 00000100:00100000:3.0:1788917075.487945:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140792064 00000100:00100000:3.0:1788917075.487957:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140792320 00000100:00100000:3.0:1788917075.487960:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140792320 00000100:00100000:0.0:1788917075.487971:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788917075.487980:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140792192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917075.487982:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788917075.487996:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140792064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917075.488019:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140792192:12345-0@lo:400:kworker.0 Request processed in 40us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917075.488022:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140792064:12345-0@lo:400:kworker.0 Request processed in 29us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917075.488026:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788917075.488028:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788917075.488038:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788917075.488607:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140791936 00000100:00100000:0.0:1788917075.488614:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140791936 00000100:00100000:0.0:1788917075.488664:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788917075.488672:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140791936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917075.488721:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140791936:12345-0@lo:400:kworker.0 Request processed in 50us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917075.488728:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788917075.488760:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788917075.488766:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917075.488797:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140791936:0@lo:400:kworker.0 00000100:00100000:0.0:1788917075.488931:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140792064:0@lo:400:kworker.0 00000100:00100000:0.0:1788917075.488953:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140791680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917075.488976:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140792192:0@lo:400:kworker.0 00000100:00100000:3.0:1788917075.489787:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140792320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917075.489851:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140792320:12345-0@lo:400:kworker.0 Request processed in 1807us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917075.489859:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788917075.491121:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140792320:0@lo:400:kworker.0 00000040:00080000:2.0:1788917075.505292:0:16435:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917075.505305:0:16435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917075.505349:0:16435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788917075.505355:0:16435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788917075.614213:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917075.615003:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113552640 00000100:00100000:3.0:1788917075.615016:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113552640 00000100:00100000:3.0:1788917075.615077:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:3.0:1788917075.615088:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+17:14593:x1875815113552640:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788917075.615120:0:14264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917075.615165:0:14264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa40 expref: -99 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917075.615479:0:14264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1788917075.615670:0:14264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee4a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa40 expref: 19 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.615690:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6e03d86600) 00010000:00010000:3.0:1788917075.615693:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788917075.615699:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa40 expref: 19 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.615714:0:14264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18fc00, rc 0) 00000100:00100000:3.0:1788917075.615808:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+18:14593:x1875815113552640:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 721us (1608us total) trans 8589934634 rc 301/301 00000100:00100000:3.0:1788917075.615816:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:2.0:1788917075.619178:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917075.619267:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113552768 00000100:00100000:0.0:1788917075.619280:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113552768 00000100:00100000:0.0:1788917075.619340:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:0.0:1788917075.619351:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+18:14593:x1875815113552768:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:0.0:1788917075.619442:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee58 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.619463:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee58 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.619478:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee58 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.619495:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabe00/0x51de7f756a83ee5f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.619503:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabe00/0x51de7f756a83ee5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.619510:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabe00/0x51de7f756a83ee5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620251:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaac00/0x51de7f756a83ee66 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620265:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaac00/0x51de7f756a83ee66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620283:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaac00/0x51de7f756a83ee66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788917075.620329:0:14265:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaac00/0x51de7f756a83ee66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620343:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee58 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620351:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee58 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620359:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee58 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620366:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcab200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917075.620370:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee58 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620378:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee58 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620393:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:0.0:1788917075.620397:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917075.620403:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee58 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620410:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab200/0x51de7f756a83ee58 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620421:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabe00/0x51de7f756a83ee5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620433:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabe00/0x51de7f756a83ee5f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620439:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabe00/0x51de7f756a83ee5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620444:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcabe00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917075.620447:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabe00/0x51de7f756a83ee5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620454:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabe00/0x51de7f756a83ee5f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620463:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6e03d86900) 00010000:00010000:0.0:1788917075.620465:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917075.620468:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabe00/0x51de7f756a83ee5f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620474:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabe00/0x51de7f756a83ee5f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620488:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaac00/0x51de7f756a83ee66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620494:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaac00/0x51de7f756a83ee66 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620500:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaac00/0x51de7f756a83ee66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620505:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcaac00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917075.620513:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaac00/0x51de7f756a83ee66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620519:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaac00/0x51de7f756a83ee66 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620527:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e03d86500) 00010000:00010000:0.0:1788917075.620529:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917075.620532:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaac00/0x51de7f756a83ee66 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.620537:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaac00/0x51de7f756a83ee66 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917075.620664:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+18:14593:x1875815113552768:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 1312us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917075.620674:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:3.0:1788917075.630651:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917075.630869:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113553024 00000100:00100000:2.0:1788917075.630903:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113553024 00000100:00100000:2.0:1788917075.630974:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:2.0:1788917075.630986:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+18:14593:x1875815113553024:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1788917075.631591:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+19:14593:x1875815113553024:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 606us (952us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1788917075.631600:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:2.0:1788917075.670813:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917075.670915:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113553280 00000100:00100000:3.0:1788917075.670927:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113553280 00000100:00100000:3.0:1788917075.670999:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:3.0:1788917075.671010:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+19:14596:x1875815113553280:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788917075.671043:0:14264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917075.671071:0:14264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee6d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa47 expref: -99 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671197:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83ee74 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671215:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83ee74 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671229:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83ee74 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671246:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ee7b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671254:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ee7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671262:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ee7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671674:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ee82 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671689:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ee82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671696:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ee82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917075.671706:0:14264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:3.0:1788917075.671833:0:14264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83ee74 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671841:0:14264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83ee74 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671849:0:14264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83ee74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671855:0:14264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917075.671860:0:14264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83ee74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671868:0:14264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83ee74 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671895:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:3.0:1788917075.671899:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917075.671904:0:14264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83ee74 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671910:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83ee74 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671923:0:14264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ee7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671936:0:14264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ee7b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671941:0:14264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ee7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671946:0:14264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917075.671949:0:14264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ee7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671956:0:14264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ee7b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671964:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6e02cee300) 00010000:00010000:3.0:1788917075.671967:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917075.671969:0:14264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ee7b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.671976:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ee7b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.672021:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee6d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa47 expref: 22 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.672035:0:14264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ee82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa47 expref: 21 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.672043:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:3.0:1788917075.672045:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788917075.672054:0:14264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18ea00, rc 0) 00000100:00100000:3.0:1788917075.672140:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+21:14596:x1875815113553280:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1131us (1340us total) trans 8589934636 rc 0/0 00000100:00100000:3.0:1788917075.672174:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:1.0:1788917075.676371:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917075.676455:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113553408 00000100:00100000:3.0:1788917075.676466:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113553408 00000100:00100000:3.0:1788917075.676521:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:3.0:1788917075.676532:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+21:14596:x1875815113553408:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:3.0:1788917075.676630:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ee90 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.676652:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ee90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.676666:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ee90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.676693:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ee90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.676697:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ee90 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.676703:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ee90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.676707:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917075.676710:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ee90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.676715:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ee90 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.676752:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:3.0:1788917075.676755:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788917075.676761:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ee90 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.676768:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ee90 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917075.677041:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+21:14596:x1875815113553408:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 509us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917075.677050:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:0.0:1788917075.681755:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917075.681814:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113553664 00000100:00100000:2.0:1788917075.681827:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113553664 00000100:00100000:2.0:1788917075.681902:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:2.0:1788917075.681914:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1edd9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+21:14596:x1875815113553664:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1788917075.682503:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1edd9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+22:14596:x1875815113553664:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 591us (770us total) trans 8589934637 rc 0/0 00000100:00100000:2.0:1788917075.682529:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:2.0:1788917075.708448:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917075.708559:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113553920 00000100:00100000:3.0:1788917075.708572:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113553920 00000100:00100000:3.0:1788917075.708639:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:3.0:1788917075.708649:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+22:12158:x1875815113553920:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1788917075.708679:0:14264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917075.708702:0:14264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ee97 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa4e expref: -99 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.708823:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee9e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.708841:0:14264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ee82 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa47 expref: 23 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.708850:0:14264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee9e lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.708891:0:14264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ee82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa47 expref: 23 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.708932:0:14264:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ee82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa47 expref: 23 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917075.708949:0:14264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f626d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14264:1875815140792448:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788917075.709066:0:14264:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e40b8f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788917075.712082:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917075.712109:0:14264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f626d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14264:1875815140792448:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788917075.712142:0:14264:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee9e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917075.712261:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113554048 00000100:00100000:0.0:1788917075.712270:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113554048 00010000:00010000:0.0:1788917075.712311:0:14250:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ee82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa47 expref: 24 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917075.712401:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:0.0:1788917075.712411:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d157800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+24:2374:x1875815113554048:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788917075.712437:0:14250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917075.712445:0:14250:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ee82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa47 expref: 24 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.712458:0:14250:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ee82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa47 expref: 24 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.712502:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18ea00/0x51de7f756a83ee82 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa47 expref: 24 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.712521:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:0.0:1788917075.712526:0:14250:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee9e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.712535:0:14250:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee9e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.712543:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee9e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.712575:0:14250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788917075.712597:0:14264:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee9e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.712604:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee9e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788917075.712622:0:14264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00000100:00100000:0.0:1788917075.712639:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d157800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+23:2374:x1875815113554048:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 228us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917075.712649:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00010000:00010000:1.0:1788917075.712809:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e000/0x51de7f756a83ee97 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa4e expref: 24 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.712829:0:14264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee9e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa4e expref: 23 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.712837:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:1.0:1788917075.712840:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788917075.712842:0:14264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18fc00, rc 0) 00000100:00100000:1.0:1788917075.713301:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+23:12158:x1875815113553920:12345-192.168.202.40@tcp:101:bash.0 Request processed in 4652us (4878us total) trans 8589934638 rc 0/0 00000100:00100000:1.0:1788917075.713310:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:1.0:1788917075.717393:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917075.717515:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113554304 00000100:00100000:0.0:1788917075.717527:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113554304 00000100:00100000:0.0:1788917075.717600:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:0.0:1788917075.717612:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+23:12158:x1875815113554304:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:0.0:1788917075.717933:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83eeac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.717954:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83eeac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.717967:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83eeac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788917075.718044:0:14265:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934639 00000004:00010000:0.0:1788917075.718071:0:14265:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003ddd74f6 reply state 00000000ee90fd6d transno 8589934640 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83eeac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917075.718081:0:14265:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788917075.718122:0:14265:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934640 00000100:00100000:0.0:1788917075.718277:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+27:12158:x1875815113554304:12345-192.168.202.40@tcp:36:bash.0 Request processed in 668us (897us total) trans 8589934641 rc 0/0 00000100:00100000:0.0:1788917075.718283:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 70 00000020:00080000:0.0:1788917075.718287:0:14265:0:(tgt_main.c:816:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788917075.719721:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83eeac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.719756:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83eeac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.719765:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83eeac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.719772:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcaa000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917075.719778:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83eeac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.719788:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83eeac lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.719806:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:2.0:1788917075.719809:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917075.719814:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83eeac lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.719821:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83eeac lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917075.720006:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917075.720060:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113554432 00000100:00100000:2.0:1788917075.720070:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113554432 00000100:00100000:2.0:1788917075.720134:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:2.0:1788917075.720170:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+26:12158:x1875815113554432:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1788917075.720216:0:16396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917075.720234:0:16396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83eeb3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa55 expref: -99 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.720296:0:16396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83eeb3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa55 expref: 27 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.720536:0:16396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83eeb3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa55 expref: 27 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.720630:0:16396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:2.0:1788917075.720634:0:16396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788917075.720638:0:16396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168e800, rc 0) 00000100:00100000:2.0:1788917075.720704:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+27:12158:x1875815113554432:12345-192.168.202.40@tcp:101:bash.0 Request processed in 560us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917075.720712:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:3.0:1788917075.723105:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917075.723192:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113554560 00000100:00100000:0.0:1788917075.723204:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113554560 00000100:00100000:0.0:1788917075.723266:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:0.0:1788917075.723274:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:12158:x1875815113554560:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1788917075.723292:0:14900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917075.723312:0:14900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e4cf588/0x51de7f756a83eeba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa5c expref: -99 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788917075.723347:0:14900:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 9, mtime: 0x6aa0b551, atime: 0x6aa0b550, ctime: 0x6aa0b551, blocks: 0xb 00010000:00010000:0.0:1788917075.723370:0:14900:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=471s v=(0 0) 00010000:00010000:0.0:1788917075.723374:0:14900:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788917075.723381:0:14900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e4cf588/0x51de7f756a83eeba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa5c expref: 7 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.723395:0:14900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000e4cf588/0x51de7f756a83eeba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa5c expref: 7 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.723423:0:14900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e3bcaa400, rc 0) 00000100:00100000:0.0:1788917075.723471:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:12158:x1875815113554560:12345-192.168.202.40@tcp:101:bash.0 Request processed in 198us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917075.723476:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:0.0:1788917075.725084:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917075.725133:0:14908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113554688 00000100:00100000:3.0:1788917075.725140:0:14908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113554688 00002000:00010000:3.0:1788917075.725200:0:14908:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (0->18446744073709551615) 00002000:00100000:3.0:1788917075.725205:0:14908:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e2d0f4e00 with x1875815113554688 ext(0->18446744073709551615) 00002000:00010000:3.0:1788917075.725215:0:14908:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6e2d0f4e00. 00000100:00100000:3.0:1788917075.725236:0:14908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:3.0:1788917075.725245:0:14908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:2374:x1875815113554688:12345-192.168.202.40@tcp:10:bash.0 00002000:00010000:3.0:1788917075.725554:0:14908:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788917075.725566:0:14908:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788917073 -> 1788917074 00002000:00010000:3.0:1788917075.725568:0:14908:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1788917072 -> 1788917072 00002000:00010000:3.0:1788917075.725569:0:14908:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788917073 -> 1788917074 00002000:00010000:3.0:1788917075.725571:0:14908:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788917075.725611:0:14908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+8:2374:x1875815113554688:12345-192.168.202.40@tcp:10:bash.0 Request processed in 368us (531us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788917075.725629:0:14908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00002000:00010000:3.0:1788917075.725632:0:14908:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (0->18446744073709551615) 00002000:00100000:3.0:1788917075.725635:0:14908:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e2d0f4e00 with x1875815113554688 ext(0->18446744073709551615) 00002000:00010000:3.0:1788917075.725638:0:14908:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6e2d0f4e00. 00000100:00100000:1.0:1788917075.784376:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917075.784435:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113554944 00000100:00100000:3.0:1788917075.784448:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113554944 00000100:00100000:3.0:1788917075.784518:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:3.0:1788917075.784533:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+27:14610:x1875815113554944:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788917075.784565:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917075.784594:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83eec1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa63 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.785073:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83eec8 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.785092:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83eec8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.785105:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83eec8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917075.785117:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1788917075.785391:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83eec1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa63 expref: 30 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.785414:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f400/0x51de7f756a83eec8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa63 expref: 29 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.785436:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:3.0:1788917075.785440:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788917075.785444:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f400, rc 0) 00000100:00100000:3.0:1788917075.785527:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+29:14610:x1875815113554944:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 997us (1163us total) trans 8589934642 rc 0/0 00000100:00100000:3.0:1788917075.785535:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:0.0:1788917075.787577:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917075.787647:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113555072 00000100:00100000:1.0:1788917075.787658:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113555072 00000100:00100000:1.0:1788917075.787720:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:1.0:1788917075.787730:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+29:14610:x1875815113555072:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:1.0:1788917075.787818:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83eed6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.787844:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83eed6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.787855:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83eed6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.787872:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83eedd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.787887:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83eedd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.787895:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83eedd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788232:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83eee4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788241:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83eee4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788250:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83eee4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788917075.788296:0:14264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83eee4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788308:0:14264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83eed6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788314:0:14264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83eed6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788322:0:14264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83eed6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788328:0:14264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d2200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917075.788333:0:14264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83eed6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788342:0:14264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83eed6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788356:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:1.0:1788917075.788359:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788917075.788364:0:14264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83eed6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788370:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83eed6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788383:0:14264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83eedd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788390:0:14264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83eedd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788402:0:14264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83eedd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788407:0:14264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d3600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917075.788410:0:14264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83eedd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788417:0:14264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83eedd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788424:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6e19456200) 00010000:00010000:1.0:1788917075.788427:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788917075.788430:0:14264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83eedd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788436:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83eedd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788449:0:14264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83eee4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788456:0:14264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83eee4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788462:0:14264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83eee4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788466:0:14264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d2800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:1.0:1788917075.788469:0:14264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83eee4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788484:0:14264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83eee4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788491:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:1.0:1788917075.788493:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788917075.788497:0:14264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83eee4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917075.788502:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2800/0x51de7f756a83eee4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917075.788589:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+29:14610:x1875815113555072:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 858us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917075.788597:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:0.0:1788917075.817846:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917075.817981:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113555328 00000100:00100000:2.0:1788917075.817994:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113555328 00000100:00100000:2.0:1788917075.818066:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 74 00000100:00100000:2.0:1788917075.818077:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+29:14613:x1875815113555328:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1788917075.818107:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917075.818135:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eeeb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa6a expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.818271:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83eef2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.818289:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83eef2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.818321:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83eef2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.818339:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83eef9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.818347:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83eef9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.818355:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83eef9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819055:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ef00 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819067:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ef00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819074:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ef00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917075.819085:0:14265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788917075.819225:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83eef2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819233:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83eef2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819241:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83eef2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819248:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168ec00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917075.819259:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83eef2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819268:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83eef2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819282:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:2.0:1788917075.819285:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917075.819290:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83eef2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819296:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83eef2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819313:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83eef9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819320:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83eef9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819325:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83eef9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819330:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917075.819333:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83eef9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819339:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83eef9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819346:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6e02f3c000) 00010000:00010000:2.0:1788917075.819348:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917075.819358:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83eef9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819364:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83eef9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819412:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83eeeb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa6a expref: 32 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819428:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ef00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa6a expref: 31 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.819436:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:2.0:1788917075.819438:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788917075.819441:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168fc00, rc 0) 00000100:00100000:2.0:1788917075.819632:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+31:14613:x1875815113555328:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1555us (1800us total) trans 8589934643 rc 0/0 00000100:00100000:2.0:1788917075.819641:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 74 00000100:00100000:3.0:1788917075.826130:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917075.826614:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113555456 00000100:00100000:1.0:1788917075.826627:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113555456 00000100:00100000:2.0:1788917075.826778:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:2.0:1788917075.826793:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+31:14613:x1875815113555456:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:2.0:1788917075.826883:0:16396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ef0e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.826906:0:16396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee9e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa4e expref: 31 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.826916:0:16396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ef0e lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.827070:0:16396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee9e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa4e expref: 31 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.827088:0:16396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee9e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa4e expref: 31 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917075.827106:0:16396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e03854e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16396:1875815140792576:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788917075.827287:0:16396:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788917075.829352:0:16396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e03854e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16396:1875815140792576:192.168.202.40@tcp:104: 00010000:00010000:2.0:1788917075.829388:0:16396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ef0e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917075.829986:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917075.830244:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113555712 00000100:00100000:2.0:1788917075.830253:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113555712 00000100:00100000:2.0:1788917075.830321:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:2.0:1788917075.830337:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+32:14275:x1875815113555712:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788917075.830725:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f625c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+33:14275:x1875815113555712:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 394us (751us total) trans 8589934644 rc 0/0 00000100:00100000:2.0:1788917075.830734:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:1.0:1788917075.836220:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917075.836366:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113555840 00000100:00100000:2.0:1788917075.836379:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113555840 00010000:00010000:2.0:1788917075.836532:0:14251:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee9e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa4e expref: 33 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917075.836623:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:2.0:1788917075.836636:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d156a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+33:2374:x1875815113555840:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788917075.836670:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917075.836678:0:14251:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee9e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa4e expref: 33 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.836693:0:14251:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee9e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa4e expref: 33 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.836721:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83ee9e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa4e expref: 33 pid: 14264 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.836750:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:2.0:1788917075.836757:0:14251:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ef0e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.836769:0:14251:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ef0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.836779:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ef0e lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.836819:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788917075.836888:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d156a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+32:2374:x1875815113555840:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 253us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917075.836897:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00010000:00010000:0.0:1788917075.837241:0:16396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ef0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.837251:0:16396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ef0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.837289:0:16396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ef0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.837297:0:16396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ef0e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.837305:0:16396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ef0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.837312:0:16396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917075.837317:0:16396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ef0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.837325:0:16396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ef0e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.837355:0:16396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:0.0:1788917075.837357:0:16396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788917075.837362:0:16396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ef0e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.837369:0:16396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83ef0e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917075.837439:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+31:14613:x1875815113555456:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 10650us (11324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917075.837448:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:1.0:1788917075.839764:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917075.839851:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113556096 00000100:00100000:2.0:1788917075.839865:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113556096 00000100:00100000:2.0:1788917075.839933:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:2.0:1788917075.839945:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+31:14613:x1875815113556096:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:2.0:1788917075.840758:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+32:14613:x1875815113556096:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 811us (1003us total) trans 8589934645 rc 0/0 00000100:00100000:2.0:1788917075.840768:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00010000:00010000:3.0:1788917075.871885:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917075.907964:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917075.908130:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113556352 00000100:00100000:0.0:1788917075.908140:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113556352 00000100:00100000:0.0:1788917075.908241:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:0.0:1788917075.908250:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+32:14624:x1875815113556352:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:0.0:1788917075.908281:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917075.908310:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83ef15 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa71 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.908635:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83ef1c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.908654:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83ef1c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.908668:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83ef1c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.908686:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef23 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.908711:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.908719:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909117:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83ef2a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909127:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83ef2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909135:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83ef2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917075.909171:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 8 00010000:00010000:0.0:1788917075.909298:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83ef1c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909307:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83ef1c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909324:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83ef1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909331:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcaae00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917075.909335:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83ef1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909344:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83ef1c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909530:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:0.0:1788917075.909533:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917075.909539:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83ef1c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909546:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83ef1c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909561:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909566:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef23 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909572:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909577:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcab600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917075.909580:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909586:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef23 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909593:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6e03d86b00) 00010000:00010000:0.0:1788917075.909595:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917075.909598:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef23 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909604:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef23 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909679:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83ef15 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa71 expref: 35 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909695:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83ef2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa71 expref: 34 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.909703:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:0.0:1788917075.909706:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788917075.909708:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e3bcab400, rc 0) 00000100:00100000:0.0:1788917075.909803:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+34:14624:x1875815113556352:12345-192.168.202.40@tcp:101:cat.0 Request processed in 1553us (1848us total) trans 8589934646 rc 0/0 00000100:00100000:0.0:1788917075.909813:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:3.0:1788917075.913665:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917075.914489:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113556608 00000100:00100000:1.0:1788917075.914500:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113556608 00000100:00100000:1.0:1788917075.914561:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:1.0:1788917075.914569:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+34:14624:x1875815113556608:12345-192.168.202.40@tcp:35:cat.0 00000100:00100000:1.0:1788917075.914859:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+35:14624:x1875815113556608:12345-192.168.202.40@tcp:35:cat.0 Request processed in 291us (1206us total) trans 8589934647 rc 0/0 00000100:00100000:1.0:1788917075.914865:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:1.0:1788917075.932624:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917075.932811:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113556864 00000100:00100000:3.0:1788917075.932824:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113556864 00000100:00100000:3.0:1788917075.932954:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:3.0:1788917075.932967:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+35:14625:x1875815113556864:12345-192.168.202.40@tcp:36:rm.0 00010000:00010000:3.0:1788917075.933041:0:14264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788917075.933079:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83ef2a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa71 expref: 35 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.933110:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168fc00/0x51de7f756a83ef00 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa6a expref: 34 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.933131:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83eeb3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa55 expref: 33 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.933219:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:3.0:1788917075.933253:0:14264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788917075.933279:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef38 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.933295:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.933307:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.933323:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ef3f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.933331:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ef3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.933617:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ef3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.934032:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ef46 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.934043:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ef46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.934050:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ef46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788917075.936495:0:14264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].3, 64 off8408 00010000:00010000:3.0:1788917075.936601:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ef4d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936620:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ef4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936640:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ef4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936649:0:14264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ef4d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936656:0:14264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ef4d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936663:0:14264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ef4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936693:0:14264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788917075.936751:0:14264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ef46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936758:0:14264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ef46 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936765:0:14264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ef46 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936772:0:14264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18fa00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917075.936776:0:14264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ef46 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936785:0:14264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ef46 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936800:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02cee800) 00010000:00010000:3.0:1788917075.936803:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788917075.936816:0:14264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ef46 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936822:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ef46 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936846:0:14264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef38 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936854:0:14264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef38 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936859:0:14264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef38 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936864:0:14264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917075.936867:0:14264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef38 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936874:0:14264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef38 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936883:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:3.0:1788917075.936886:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788917075.936889:0:14264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef38 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917075.936895:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef38 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788917075.936906:0:14264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a099cbc3 reply state 00000000d0308892 transno 8589934648 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ef3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917075.936927:0:14264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788917075.937046:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+34:14625:x1875815113556864:12345-192.168.202.40@tcp:36:rm.0 Request processed in 4076us (4431us total) trans 8589934648 rc 0/0 00000100:00100000:3.0:1788917075.937057:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 77 00010000:00010000:0.0:1788917075.937180:0:16021:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788917075.937189:0:16021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ef4d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.937196:0:16021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e600 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788917075.937201:0:16021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ef4d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.937208:0:16021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ef4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.937228:0:16021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6e02cee800) 00010000:00010000:0.0:1788917075.937231:0:16021:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788917075.937234:0:16021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ef4d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.937253:0:16021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83ef4d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.937271:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917075.937273:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917075.937275:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917075.939678:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ef3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.939701:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ef3f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.939710:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ef3f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.939718:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917075.939723:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ef3f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.939732:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ef3f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.939760:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6e02cee300) 00010000:00010000:0.0:1788917075.939764:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917075.939770:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ef3f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.939777:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83ef3f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917075.985231:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917075.990208:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113557120 00000100:00100000:2.0:1788917075.990230:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113557120 00000100:00100000:2.0:1788917075.990332:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:2.0:1788917075.990345:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+33:14631:x1875815113557120:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1788917075.990381:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917075.990410:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ef54 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa78 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.990591:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ef5b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.990607:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ef5b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.990618:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ef5b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.990629:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ef62 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.990634:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ef62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.990638:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ef62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.991254:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ef69 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.991270:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ef69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.991278:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ef69 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917075.991289:0:14265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788917075.991318:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ef5b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.991326:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ef5b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.991333:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ef5b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.991339:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168ec00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917075.991344:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ef5b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.991352:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ef5b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.991365:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:2.0:1788917075.991369:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917075.991374:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ef5b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.991381:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168ec00/0x51de7f756a83ef5b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788917075.991397:0:14265:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fbffb039 reply state 000000007501fc04 transno 8589934649 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ef62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917075.991414:0:14265:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788917075.991439:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83ef54 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa78 expref: 36 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.991452:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ef69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa78 expref: 35 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.991457:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:2.0:1788917075.991459:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788917075.991460:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168e800, rc 0) 00000100:00100000:2.0:1788917075.991540:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+36:14631:x1875815113557120:12345-192.168.202.40@tcp:101:bash.0 Request processed in 1199us (6325us total) trans 8589934649 rc 0/0 00000100:00100000:2.0:1788917075.991546:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 78 00010000:00010000:2.0:1788917075.995469:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ef62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.995489:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ef62 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.995496:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ef62 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.995501:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917075.995505:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ef62 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.995510:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ef62 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.995549:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6e02f3c000) 00010000:00010000:2.0:1788917075.995551:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917075.995555:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ef62 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917075.995559:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83ef62 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917075.996580:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917075.996668:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113557248 00000100:00100000:0.0:1788917075.996683:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113557248 00000100:00100000:0.0:1788917075.996757:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:0.0:1788917075.996774:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+35:14631:x1875815113557248:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1788917075.996810:0:16396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917075.996835:0:16396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83ef77 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa7f expref: -99 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.996925:0:16396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef7e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.996940:0:16396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.996952:0:16396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917075.996993:0:16396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788917075.996996:0:16396:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788917075.997012:0:16396:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.997021:0:16396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.997039:0:16396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83ef77 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa7f expref: 37 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.997052:0:16396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa7f expref: 36 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917075.997058:0:16396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:0.0:1788917075.997065:0:16396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788917075.997067:0:16396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e3bcab600, rc 0) 00000100:00100000:0.0:1788917075.997125:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+36:14631:x1875815113557248:12345-192.168.202.40@tcp:101:bash.0 Request processed in 359us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917075.997130:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:3.0:1788917076.002648:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917076.002761:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113557504 00000100:00100000:2.0:1788917076.002773:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113557504 00000100:00100000:2.0:1788917076.002857:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:2.0:1788917076.002870:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+36:14631:x1875815113557504:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:2.0:1788917076.003314:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+37:14631:x1875815113557504:12345-192.168.202.40@tcp:35:bash.0 Request processed in 446us (679us total) trans 8589934650 rc 0/0 00000100:00100000:2.0:1788917076.003324:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00080000:0.0:1788917076.003534:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917076.105464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.105577:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113557760 00000100:00100000:3.0:1788917076.105588:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113557760 00000100:00100000:3.0:1788917076.105657:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:3.0:1788917076.105668:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+37:14644:x1875815113557760:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1788917076.105708:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917076.105730:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef85 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa86 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.105878:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ef8c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.105893:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ef8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.105905:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ef8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917076.105918:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788917076.106052:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef85 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa86 expref: 40 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.106071:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ef8c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa86 expref: 39 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.106096:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:3.0:1788917076.106099:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788917076.106102:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18fa00, rc 0) 00000100:00100000:3.0:1788917076.106341:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+39:14644:x1875815113557760:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 665us (875us total) trans 8589934651 rc 0/0 00000100:00100000:3.0:1788917076.106351:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:2.0:1788917076.109008:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.109200:0:14252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113557888 00000100:00100000:3.0:1788917076.109212:0:14252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113557888 00000100:00100000:0.0:1788917076.109866:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:0.0:1788917076.109882:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03854e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+39:2373:x1875815113557888:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788917076.109901:0:14250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917076.109929:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83ef8c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa86 expref: 39 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.109950:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:0.0:1788917076.109955:0:14250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788917076.110131:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03854e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+38:2373:x1875815113557888:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 253us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917076.110140:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:1.0:1788917076.110618:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.111296:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113558016 00000100:00100000:3.0:1788917076.111305:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113558016 00000100:00100000:3.0:1788917076.111469:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:3.0:1788917076.111480:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+38:14644:x1875815113558016:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:3.0:1788917076.111548:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef9a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.111566:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.111578:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.111611:0:14264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.111618:0:14264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef9a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.111625:0:14264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.111646:0:14264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917076.111652:0:14264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.111660:0:14264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef9a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.111673:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:3.0:1788917076.111677:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788917076.111682:0:14264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef9a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.111700:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83ef9a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917076.111784:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+38:14644:x1875815113558016:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 306us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917076.111791:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 81 00000100:00100000:2.0:1788917076.113307:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917076.113439:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113558272 00000100:00100000:1.0:1788917076.113447:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113558272 00000100:00100000:1.0:1788917076.113609:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:1.0:1788917076.113619:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+38:14644:x1875815113558272:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1788917076.114424:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+39:14644:x1875815113558272:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 805us (1121us total) trans 8589934652 rc 0/0 00000100:00100000:1.0:1788917076.114431:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:2.0:1788917076.172097:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.172194:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113558528 00000100:00100000:3.0:1788917076.172210:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113558528 00000100:00100000:3.0:1788917076.172345:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00100000:3.0:1788917076.172359:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+39:14654:x1875815113558528:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1788917076.172394:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917076.172423:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83efa1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa8d expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.172537:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83efa8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.172656:0:14265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ef69 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa78 expref: 40 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.172667:0:14265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef7e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa7f expref: 40 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.172676:0:14265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83efa8 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.172722:0:14265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa7f expref: 40 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.172871:0:14265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa7f expref: 40 pid: 16396 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917076.172890:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37135500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14265:1875815140792704:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788917076.173057:0:14265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ef69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa78 expref: 40 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.173069:0:14265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ef69 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa78 expref: 40 pid: 14265 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917076.173081:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14265:1875815140792832:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788917076.173108:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e40b8fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788917076.176334:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.176353:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37135500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14265:1875815140792704:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788917076.176370:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14265:1875815140792832:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788917076.176382:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00010000:00010000:3.0:1788917076.176433:0:14265:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83efa8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917076.176440:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113558784 00000100:00100000:1.0:1788917076.176453:0:16404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113558784 00010000:00010000:1.0:1788917076.176501:0:16404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ef69 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa78 expref: 41 pid: 14265 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917076.176671:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113558656 00000100:00100000:1.0:1788917076.176675:0:16404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113558656 00010000:00010000:1.0:1788917076.176693:0:16404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa7f expref: 42 pid: 16396 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917076.176720:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:2.0:1788917076.176729:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03854a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+42:2373:x1875815113558784:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788917076.176756:0:14250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917076.176769:0:14250:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ef69 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa78 expref: 42 pid: 14265 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.176802:0:14250:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ef69 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa78 expref: 42 pid: 14265 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.176826:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83ef69 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa78 expref: 42 pid: 14265 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.176845:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:2.0:1788917076.176851:0:14250:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83efa8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.176859:0:14250:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83efa8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.176867:0:14250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788917076.176938:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03854a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+41:2373:x1875815113558784:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 210us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917076.176947:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:2.0:1788917076.176967:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:2.0:1788917076.176974:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2ea8f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+40:2373:x1875815113558656:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788917076.176982:0:14250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917076.176988:0:14250:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa7f expref: 40 pid: 16396 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.177001:0:14250:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa7f expref: 40 pid: 16396 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.177026:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83ef7e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa7f expref: 40 pid: 16396 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.177038:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:2.0:1788917076.177041:0:14250:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83efa8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.177050:0:14250:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83efa8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.177058:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83efa8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.177085:0:14250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788917076.177106:0:14265:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83efa8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917076.177129:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2ea8f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+39:2373:x1875815113558656:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 150us (743us total) trans 0 rc 0/0 00010000:00010000:3.0:1788917076.177138:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83efa8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917076.177195:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000004:00200000:3.0:1788917076.177530:0:14265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788917076.177990:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83efa1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa8d expref: 40 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.178016:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83efa8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa8d expref: 39 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.178026:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:3.0:1788917076.178029:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788917076.178032:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e800, rc 0) 00000100:00100000:3.0:1788917076.178099:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+39:14654:x1875815113558528:12345-192.168.202.40@tcp:101:bash.0 Request processed in 5743us (6011us total) trans 8589934653 rc 0/0 00000100:00100000:3.0:1788917076.178108:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 82 00000100:00100000:3.0:1788917076.180774:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917076.180867:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113559040 00000100:00100000:0.0:1788917076.180878:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113559040 00000100:00100000:0.0:1788917076.180972:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:0.0:1788917076.180982:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+39:14654:x1875815113559040:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:0.0:1788917076.181331:0:16396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efb6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.181349:0:16396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efb6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.181360:0:16396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efb6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788917076.181430:0:16396:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934654 00000004:00010000:0.0:1788917076.181453:0:16396:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ef722fc reply state 00000000885c33d7 transno 8589934655 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efb6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917076.181463:0:16396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788917076.181557:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+42:14654:x1875815113559040:12345-192.168.202.40@tcp:36:bash.0 Request processed in 575us (793us total) trans 8589934655 rc 0/0 00000100:00100000:0.0:1788917076.181564:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 83 00000020:00080000:0.0:1788917076.181569:0:16396:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788917076.186262:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efb6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.186283:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efb6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.186291:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efb6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.186297:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcabc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917076.186464:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efb6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.186474:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efb6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.186493:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:0.0:1788917076.186496:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917076.186502:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efb6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.186509:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efb6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917076.187132:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917076.187263:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113559168 00000100:00100000:2.0:1788917076.187275:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113559168 00000100:00100000:2.0:1788917076.187812:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:2.0:1788917076.187825:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+41:14654:x1875815113559168:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1788917076.187852:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917076.187872:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83efbd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa94 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.187937:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83efbd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa94 expref: 42 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.187969:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83efbd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa94 expref: 42 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.187991:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:2.0:1788917076.187994:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788917076.187997:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168e800, rc 0) 00000100:00100000:2.0:1788917076.188059:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+42:14654:x1875815113559168:12345-192.168.202.40@tcp:101:bash.0 Request processed in 237us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917076.188067:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:2.0:1788917076.191531:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.191609:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113559296 00000100:00100000:3.0:1788917076.191620:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113559296 00000100:00100000:3.0:1788917076.191677:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00100000:3.0:1788917076.191686:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+42:14654:x1875815113559296:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1788917076.191721:0:14264:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917076.191751:0:14264:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83efc4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fa9b expref: -99 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.191862:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83efcb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.191877:0:14264:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83efa8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa8d expref: 43 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.191888:0:14264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83efcb lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.191922:0:14264:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83efa8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa8d expref: 43 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.191935:0:14264:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83efa8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa8d expref: 43 pid: 14265 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917076.191950:0:14264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd31f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14264:1875815140792960:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788917076.192038:0:14264:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e40b8fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788917076.193935:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.193991:0:14264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd31f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14264:1875815140792960:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788917076.194037:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113559424 00010000:00010000:3.0:1788917076.194043:0:14264:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83efcb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917076.194048:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113559424 00010000:00010000:2.0:1788917076.194086:0:14250:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83efa8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa8d expref: 44 pid: 14265 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917076.194129:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:2.0:1788917076.194138:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+44:2373:x1875815113559424:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788917076.194188:0:14250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917076.194196:0:14250:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83efa8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa8d expref: 44 pid: 14265 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.194211:0:14250:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83efa8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa8d expref: 44 pid: 14265 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.194233:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83efa8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa8d expref: 44 pid: 14265 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.194263:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:2.0:1788917076.194269:0:14250:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83efcb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.194277:0:14250:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83efcb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.194284:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83efcb lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.194318:0:14250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788917076.194365:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+43:2373:x1875815113559424:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 227us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917076.194373:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00010000:00010000:3.0:1788917076.194522:0:14264:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83efcb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.194532:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83efcb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917076.194615:0:14264:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788917076.194625:0:14264:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788917076.194652:0:14264:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83efcb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.194690:0:14264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83efc4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa9b expref: 43 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.194714:0:14264:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83efcb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa9b expref: 42 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.194723:0:14264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:3.0:1788917076.194727:0:14264:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788917076.194730:0:14264:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f000, rc 0) 00000100:00100000:3.0:1788917076.194808:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+42:14654:x1875815113559296:12345-192.168.202.40@tcp:101:bash.0 Request processed in 3122us (3284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917076.194817:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 85 00000100:00100000:0.0:1788917076.198272:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.198390:0:14252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113559680 00000100:00100000:3.0:1788917076.198405:0:14252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113559680 00000100:00100000:3.0:1788917076.198562:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:3.0:1788917076.198586:0:14252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+42:14654:x1875815113559680:12345-192.168.202.40@tcp:103:bash.0 00010000:00010000:3.0:1788917076.198607:0:14252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788917076.198641:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83efcb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa9b expref: 42 pid: 14264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.198673:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168e800/0x51de7f756a83efbd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa94 expref: 41 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.198713:0:14252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02f3cf00) 00010000:00010000:3.0:1788917076.198728:0:14252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788917076.198914:0:14252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+40:14654:x1875815113559680:12345-192.168.202.40@tcp:103:bash.0 Request processed in 341us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917076.198923:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:2.0:1788917076.200845:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.201179:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113559808 00000100:00100000:3.0:1788917076.201190:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113559808 00000100:00100000:3.0:1788917076.201290:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:3.0:1788917076.201301:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+40:14654:x1875815113559808:12345-192.168.202.40@tcp:58:bash.0 00010000:00010000:3.0:1788917076.201457:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83efd2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.201474:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83efd2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.201485:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83efd2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788917076.201837:0:14266:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].2, 136 off8464 00000100:00100000:3.0:1788917076.201932:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+40:14654:x1875815113559808:12345-192.168.202.40@tcp:58:bash.0 Request processed in 631us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917076.201940:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:2.0:1788917076.207984:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917076.208075:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113559936 00000100:00100000:0.0:1788917076.208089:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113559936 00000100:00100000:0.0:1788917076.208190:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 87 00000100:00100000:0.0:1788917076.208199:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+40:14654:x1875815113559936:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1788917076.208222:0:16396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917076.208246:0:16396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efd9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8faa2 expref: -99 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.208302:0:16396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83efd2 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.208312:0:16396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efd9 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8faa2 expref: 41 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.208329:0:16396:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83efd2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.208338:0:16396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efd9 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8faa2 expref: 41 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.208349:0:16396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:0.0:1788917076.208351:0:16396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788917076.208354:0:16396:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efd9 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8faa2 expref: 41 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.208377:0:16396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e3bcabc00, rc 0) 00000100:00100000:0.0:1788917076.208447:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+41:14654:x1875815113559936:12345-192.168.202.40@tcp:101:bash.0 Request processed in 249us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917076.208452:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 87 00000040:00080000:0.0:1788917076.383456:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917076.383466:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917076.383498:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788917076.383504:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788917076.383639:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0f6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14298:1875815140793088:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788917076.383807:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36436c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788917076.389971:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.390141:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113560064 00000100:00100000:3.0:1788917076.390183:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113560064 00000100:00100000:3.0:1788917076.390250:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:3.0:1788917076.390261:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+42:14655:x1875815113560064:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788917076.390300:0:14265:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788917076.390441:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+42:14655:x1875815113560064:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 182us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917076.390449:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:0.0:1788917076.392924:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0f6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14298:1875815140793088:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788917076.393689:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917076.393778:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113560192 00000100:00100000:0.0:1788917076.393786:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113560192 00000100:00100000:0.0:1788917076.393886:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:0.0:1788917076.393897:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+41:14655:x1875815113560192:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788917076.393975:0:16396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83efe0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.394007:0:16396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83efe0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.394020:0:16396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83efe0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397087:0:16396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83efe7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397141:0:16396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83efe7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397175:0:16396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83efe7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397214:0:16396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83efee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397223:0:16396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83efee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397230:0:16396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83efee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917076.397281:0:16396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788917076.397285:0:16396:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788917076.397300:0:16396:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83efee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397312:0:16396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83efe0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397319:0:16396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83efe0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397326:0:16396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83efe0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397331:0:16396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcaae00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917076.397336:0:16396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83efe0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397350:0:16396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83efe0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397366:0:16396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6e02f3c500) 00010000:00010000:0.0:1788917076.397369:0:16396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917076.397374:0:16396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83efe0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397380:0:16396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaae00/0x51de7f756a83efe0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397461:0:16396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83efe7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397470:0:16396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83efe7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397476:0:16396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83efe7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397481:0:16396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcab600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917076.397484:0:16396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83efe7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397490:0:16396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83efe7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397497:0:16396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdfbec3e4 (ffff9a6e03d86b00) 00010000:00010000:0.0:1788917076.397500:0:16396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917076.397503:0:16396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83efe7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397583:0:16396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83efe7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397603:0:16396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83efee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397608:0:16396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83efee lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397614:0:16396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83efee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397619:0:16396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcab400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917076.397622:0:16396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83efee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397628:0:16396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83efee lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397637:0:16396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:0.0:1788917076.397640:0:16396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917076.397643:0:16396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83efee lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.397649:0:16396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83efee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917076.397780:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+41:14655:x1875815113560192:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 Request processed in 3879us (4086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917076.397792:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:2.0:1788917076.407415:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.407651:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113560448 00000100:00100000:3.0:1788917076.407664:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113560448 00000100:00100000:3.0:1788917076.407743:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 90 00000100:00100000:3.0:1788917076.407754:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+41:14655:x1875815113560448:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788917076.407778:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917076.407801:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83eff5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8faa9 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.407921:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83effc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.407937:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83effc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.407949:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83effc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917076.407960:0:14265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788917076.408081:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83effc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.408089:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83effc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.408095:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83effc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.408279:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:3.0:1788917076.408295:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83effc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.408304:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83effc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.408317:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:3.0:1788917076.408320:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788917076.408324:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83effc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.408331:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83effc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.408377:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83eff5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8faa9 expref: 43 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.408389:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a6e02f3c500) 00010000:00010000:3.0:1788917076.408391:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788917076.408395:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83eff5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8faa9 expref: 43 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.408404:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f000, rc 0) 00000100:00100000:3.0:1788917076.408469:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+42:14655:x1875815113560448:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 716us (1063us total) trans 8589934656 rc 301/301 00000100:00100000:3.0:1788917076.408477:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 90 00000100:00100000:2.0:1788917076.414536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.414624:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113560576 00000100:00100000:3.0:1788917076.414636:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113560576 00000100:00100000:3.0:1788917076.414701:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 91 00000100:00100000:3.0:1788917076.414713:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+42:14655:x1875815113560576:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788917076.414783:0:14264:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788917076.414911:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+42:14655:x1875815113560576:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 200us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917076.414919:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 91 00000100:00100000:2.0:1788917076.417586:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.417676:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113560832 00000100:00100000:3.0:1788917076.417688:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113560832 00000100:00100000:3.0:1788917076.417797:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 92 00000100:00100000:3.0:1788917076.417807:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+42:14655:x1875815113560832:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788917076.417829:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917076.417852:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83f00a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fab0 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788917076.418833:0:14266:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1788917076.418843:0:14266:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1788917076.418895:0:14266:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1788917076.419099:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83f011 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.419559:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83f011 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.419571:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83f011 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.419648:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83f00a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fab0 expref: 45 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.419669:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83f011 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fab0 expref: 44 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.419694:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6e02ceef00) 00010000:00010000:3.0:1788917076.419697:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788917076.419700:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f200, rc 0) 00000100:00100000:3.0:1788917076.419788:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+44:14655:x1875815113560832:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 1982us (2211us total) trans 8589934657 rc 0/0 00000100:00100000:3.0:1788917076.419798:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 92 00000100:00100000:2.0:1788917076.424637:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917076.424888:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113561088 00000100:00100000:0.0:1788917076.424900:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113561088 00000100:00100000:0.0:1788917076.425006:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 93 00000100:00100000:0.0:1788917076.425017:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+44:14655:x1875815113561088:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788917076.425089:0:16396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917076.425129:0:16396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83f011 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fab0 expref: 44 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425181:0:16396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6e02ceef00) 00010000:00010000:0.0:1788917076.425203:0:16396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788917076.425227:0:16396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83f01f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425242:0:16396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83f01f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425253:0:16396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83f01f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425269:0:16396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83f026 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xbb88a043 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425276:0:16396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83f026 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbb88a043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425283:0:16396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83f026 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbb88a043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425363:0:16396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83f01f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425389:0:16396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83f01f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425396:0:16396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83f01f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425402:0:16396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcab400 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917076.425407:0:16396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83f01f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425415:0:16396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83f01f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425425:0:16396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:0.0:1788917076.425428:0:16396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917076.425432:0:16396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83f01f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425438:0:16396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab400/0x51de7f756a83f01f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425448:0:16396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83f026 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbb88a043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425454:0:16396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83f026 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbb88a043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425459:0:16396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83f026 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbb88a043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425464:0:16396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcab600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917076.425473:0:16396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83f026 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbb88a043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425479:0:16396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83f026 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xbb88a043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425486:0:16396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xbb88a043 (ffff9a6e03d86b00) 00010000:00010000:0.0:1788917076.425489:0:16396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917076.425491:0:16396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83f026 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xbb88a043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.425496:0:16396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab600/0x51de7f756a83f026 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xbb88a043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917076.425581:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+43:14655:x1875815113561088:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 565us (954us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788917076.425589:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 93 00000100:00100000:1.0:1788917076.430488:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917076.430663:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113561216 00000100:00100000:2.0:1788917076.430672:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113561216 00000100:00100000:2.0:1788917076.430741:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 94 00000100:00100000:2.0:1788917076.430752:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+43:14655:x1875815113561216:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788917076.430775:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788917076.430810:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83f02d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fab7 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.430842:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83f034 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.430852:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83f034 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.430860:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83f034 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.430945:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f400/0x51de7f756a83f02d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fab7 expref: 45 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.430960:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f800/0x51de7f756a83f034 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fab7 expref: 44 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.430966:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:2.0:1788917076.430969:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788917076.430971:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e0168f800, rc 0) 00000100:00100000:2.0:1788917076.431071:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+44:14655:x1875815113561216:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 320us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917076.431078:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 94 00000100:00100000:2.0:1788917076.434880:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.434979:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113561472 00000100:00100000:3.0:1788917076.434990:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113561472 00000100:00100000:3.0:1788917076.435085:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 95 00000100:00100000:3.0:1788917076.435096:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+44:14655:x1875815113561472:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788917076.435488:0:14264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83f03b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.435516:0:14264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83f03b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.435527:0:14264:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83f03b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788917076.436437:0:14264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1788917076.436492:0:14264:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 472468345506ns, next at 473468342777ns, rc = 0 00000004:00010000:3.0:1788917076.436563:0:14264:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b5f0249b reply state 00000000a8605698 transno 8589934658 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83f03b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917076.436571:0:14264:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788917076.436704:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+46:14655:x1875815113561472:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 1609us (1831us total) trans 8589934658 rc 0/0 00000100:00100000:3.0:1788917076.436720:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 95 00000100:00100000:1.0:1788917076.440474:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.440606:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113561600 00000100:00100000:3.0:1788917076.440657:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113561600 00000100:00100000:3.0:1788917076.440744:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 96 00000100:00100000:3.0:1788917076.440755:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+46:14655:x1875815113561600:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788917076.440783:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917076.440805:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83f042 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fabe expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.440861:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83f042 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fabe expref: 47 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.440872:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83f042 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fabe expref: 47 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.440886:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:3.0:1788917076.440888:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788917076.440891:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18f200, rc 0) 00000100:00100000:3.0:1788917076.440943:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+47:14655:x1875815113561600:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 191us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917076.440948:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 96 00010000:00010000:2.0:1788917076.441778:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83f03b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.441791:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83f03b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.441815:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83f03b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.441826:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f000 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917076.441830:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83f03b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.441839:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83f03b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.441851:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:2.0:1788917076.441854:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788917076.441858:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83f03b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.441863:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f000/0x51de7f756a83f03b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14264 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917076.443513:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917076.443599:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113561728 00000100:00100000:0.0:1788917076.443608:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113561728 00000100:00100000:0.0:1788917076.443667:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:0.0:1788917076.443675:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+5:2373:x1875815113561728:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788917076.443777:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917076.444027:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2373:x1875815113561728:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 351us (522us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788917076.444036:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:1.0:1788917076.445788:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.445924:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113561984 00000100:00100000:3.0:1788917076.445932:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113561984 00000100:00100000:3.0:1788917076.446022:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1788917076.446032:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1eddac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+46:14655:x1875815113561984:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788917076.446310:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1eddac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+47:14655:x1875815113561984:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 279us (527us total) trans 8589934659 rc 0/0 00000100:00100000:3.0:1788917076.446340:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:2.0:1788917076.449777:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917076.449889:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113562240 00000100:00100000:0.0:1788917076.449900:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113562240 00000100:00100000:0.0:1788917076.449963:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 97 00000100:00100000:0.0:1788917076.449973:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+47:14655:x1875815113562240:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788917076.450348:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+47:14655:x1875815113562240:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 374us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917076.450356:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 97 00000100:00100000:2.0:1788917076.454453:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.454681:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113562368 00000100:00100000:3.0:1788917076.454694:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113562368 00000100:00100000:3.0:1788917076.454821:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 98 00000100:00100000:3.0:1788917076.454833:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+47:14655:x1875815113562368:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788917076.454858:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917076.454879:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83f049 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fac5 expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.454957:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83f050 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.454970:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83f050 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.454980:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83f050 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788917076.455018:0:14265:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788917076.455040:0:14265:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83f050 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.455068:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e800/0x51de7f756a83f049 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fac5 expref: 49 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.455086:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83f050 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fac5 expref: 48 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.455093:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:3.0:1788917076.455108:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788917076.455111:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18fa00, rc 0) 00000100:00100000:3.0:1788917076.455202:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+48:14655:x1875815113562368:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 372us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917076.455208:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 98 00000100:00100000:1.0:1788917076.459748:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.459855:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113562496 00000100:00100000:3.0:1788917076.459866:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113562496 00000100:00100000:3.0:1788917076.459977:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:3.0:1788917076.459989:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113562496:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788917076.460008:0:14903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788917076.460029:0:14903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83f057 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8facc expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788917076.460056:0:14903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0b553, blocks: 0x1 00010000:00010000:3.0:1788917076.460077:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1788917076.460082:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788917076.460091:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83f057 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8facc expref: 7 pid: 14903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.460110:0:14903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83f057 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8facc expref: 7 pid: 14903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.460124:0:14903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e2d18e800, rc 0) 00000100:00100000:3.0:1788917076.460221:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d154000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:2374:x1875815113562496:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 234us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917076.460229:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:1.0:1788917076.463600:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.464817:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113562752 00000100:00100000:3.0:1788917076.464829:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113562752 00000100:00100000:3.0:1788917076.464991:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 99 00000100:00100000:3.0:1788917076.465003:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+48:14655:x1875815113562752:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788917076.465137:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+48:14655:x1875815113562752:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 135us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917076.465165:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 99 00000100:00100000:2.0:1788917076.467409:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917076.467485:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113562880 00000100:00100000:0.0:1788917076.467493:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113562880 00000100:00100000:0.0:1788917076.467543:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 100 00000100:00100000:0.0:1788917076.467552:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+48:14655:x1875815113562880:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788917076.498642:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934655 is committed 00000020:00080000:2.0:1788917076.498682:0:5814:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6e36436480 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:2.0:1788917076.498689:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e3a18c400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e36436a80 00000020:00080000:2.0:1788917076.498693:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e3a18c100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e1eb8d400 00000001:00080000:2.0:1788917076.498762:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934659 is committed 00000020:00080000:3.0:1788917076.498765:0:14303:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000004:00080000:2.0:1788917076.498770:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788917076.498961:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e03855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140793216:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1788917076.498971:0:14303:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1788917076.499045:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917076.499694:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140793216 00000100:00100000:3.0:1788917076.499703:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140793216 00000100:00100000:3.0:1788917076.499775:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788917076.499787:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140793216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788917076.499798:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:14655:x1875815113562880:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 Request processed in 32243us (32389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917076.499809:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 100 00002000:00010000:3.0:1788917076.499977:0:16200:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788917076.500041:0:16200:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788917076.500044:0:16200:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788917076.500046:0:16200:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788917075 -> 1788917075 00002000:00010000:3.0:1788917076.500048:0:16200:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788917076.500104:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140793216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 319us (1059us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788917076.500111:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1788917076.500670:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6e03855180/2, rc 0, transno 8589934595 00000100:00100000:0.0:1788917076.500679:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e03855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140793216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788917076.507040:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917076.507632:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113563008 00000100:00100000:0.0:1788917076.507644:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113563008 00000100:00100000:1.0:1788917076.507888:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:1.0:1788917076.507900:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:2373:x1875815113563008:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788917076.508293:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:2373:x1875815113563008:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 Request processed in 394us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917076.508304:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:3.0:1788917076.515700:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917076.520322:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113563264 00000100:00100000:1.0:1788917076.520350:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113563264 00000100:00100000:1.0:1788917076.520421:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 101 00000100:00100000:1.0:1788917076.520433:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:14655:x1875815113563264:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788917076.520498:0:16396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788917076.520534:0:16396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fa00/0x51de7f756a83f050 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fac5 expref: 14 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.520558:0:16396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:1.0:1788917076.520564:0:16396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788917076.520597:0:16396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83f05e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.520615:0:16396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83f05e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.520626:0:16396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83f05e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788917076.520811:0:16396:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000844228f3 reply state 0000000033984d3d transno 8589934660 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83f05e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917076.520822:0:16396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788917076.520938:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+15:14655:x1875815113563264:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 506us (5247us total) trans 8589934660 rc 0/0 00000100:00100000:1.0:1788917076.520960:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 101 00010000:00010000:0.0:1788917076.524445:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83f05e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.524465:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83f05e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.524473:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83f05e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.524480:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e1e9d2200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917076.524485:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83f05e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.524493:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83f05e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.524525:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:0.0:1788917076.524528:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917076.524533:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83f05e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.524540:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83f05e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917076.526495:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917076.526541:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113563392 00000100:00100000:1.0:1788917076.526552:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113563392 00000100:00100000:1.0:1788917076.526609:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:1.0:1788917076.526620:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:2373:x1875815113563392:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788917076.526920:0:14901:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788917076.526924:0:14901:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788917075 00002000:00010000:1.0:1788917076.526927:0:14901:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788917075 00002000:00010000:1.0:1788917076.526929:0:14901:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788917075 -> 1788917075 00002000:00010000:1.0:1788917076.526932:0:14901:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788917076.526995:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+8:2373:x1875815113563392:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 376us (511us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788917076.527003:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:2.0:1788917076.531986:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.532163:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113563520 00000100:00100000:3.0:1788917076.532176:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113563520 00000100:00100000:3.0:1788917076.532234:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:3.0:1788917076.532243:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+8:2373:x1875815113563520:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788917076.532295:0:14903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005b8e991e/0x51de7f756a83f065 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.532319:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788917076.532323:0:14903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788917076.532328:0:14903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b8e991e/0x51de7f756a83f065 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.532389:0:14903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b8e991e/0x51de7f756a83f065 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.532420:0:14903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005b8e991e/0x51de7f756a83f065 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.532425:0:14903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b8e991e/0x51de7f756a83f065 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.532431:0:14903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b8e991e/0x51de7f756a83f065 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.532435:0:14903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f600 already unused, calling callback (ffffffffc1729220) 00010000:00010000:3.0:1788917076.532440:0:14903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8e991e/0x51de7f756a83f065 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.532449:0:14903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b8e991e/0x51de7f756a83f065 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.532466:0:14903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b8e991e/0x51de7f756a83f065 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.532482:0:14903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b8e991e/0x51de7f756a83f065 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917076.532554:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+8:2373:x1875815113563520:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 Request processed in 312us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917076.532560:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000001:00080000:2.0:1788917076.537600:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:2.0:1788917076.537622:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000100:00100000:2.0:1788917076.538557:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.538655:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113563776 00000100:00100000:3.0:1788917076.538669:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113563776 00000100:00100000:3.0:1788917076.538745:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 102 00000100:00100000:3.0:1788917076.538768:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:14655:x1875815113563776:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788917076.538884:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83f06c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.538910:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83f06c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.538925:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83f06c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.539192:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83f073 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.539204:0:14265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83f042 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fabe expref: 15 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.539216:0:14265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83f073 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.539275:0:14265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83f042 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fabe expref: 15 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.539288:0:14265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83f042 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fabe expref: 15 pid: 14265 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917076.539302:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14265:1875815140793344:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788917076.539571:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e0a638f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788917076.545526:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.545614:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14265:1875815140793344:192.168.202.40@tcp:104: 00010000:00010000:3.0:1788917076.545641:0:14265:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83f073 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917076.545709:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113563904 00000100:00100000:2.0:1788917076.545717:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113563904 00010000:00010000:2.0:1788917076.545773:0:14250:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83f042 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fabe expref: 16 pid: 14265 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917076.545859:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:2.0:1788917076.545870:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+16:2374:x1875815113563904:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788917076.545888:0:14250:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788917076.545897:0:14250:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83f042 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fabe expref: 16 pid: 14265 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.545911:0:14250:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83f042 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fabe expref: 16 pid: 14265 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.545938:0:14250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f200/0x51de7f756a83f042 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fabe expref: 16 pid: 14265 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.545958:0:14250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:2.0:1788917076.545963:0:14250:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83f073 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.545974:0:14250:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83f073 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.545999:0:14250:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83f073 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.546027:0:14250:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788917076.546091:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+15:2374:x1875815113563904:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 222us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917076.546098:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00010000:00010000:3.0:1788917076.546165:0:14265:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83f073 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.546173:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83f073 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788917076.546413:0:14265:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934661 00000001:00080000:3.0:1788917076.546573:0:14265:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934662 00000001:00080000:3.0:1788917076.546616:0:14265:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934663 00000100:00100000:3.0:1788917076.546701:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14265:1875815140793472:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788917076.546778:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917076.546815:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e0a6386c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788917076.547799:0:14270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140793472 00000100:00100000:1.0:1788917076.547810:0:14270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140793472 00000100:00100000:1.0:1788917076.547869:0:14270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788917076.547878:0:14270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14265:x1875815140793472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788917076.548028:0:14270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14265:x1875815140793472:12345-0@lo:1000:mdt00_001.0 Request processed in 150us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917076.548036:0:14270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788917076.548352:0:14265:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934595 gen 2 00000004:00080000:3.0:1788917076.548359:0:14265:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6e03855180, transno 8589934595 00000100:00100000:3.0:1788917076.548412:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14265:1875815140793472:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788917076.549448:0:14265:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934664 00000100:00100000:2.0:1788917076.549525:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f326a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14265:1875815140793600:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788917076.549581:0:14265:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917076.549665:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e40b8fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788917076.549708:0:14270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140793600 00000100:00100000:1.0:1788917076.549715:0:14270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140793600 00000100:00100000:1.0:1788917076.549819:0:14270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788917076.549828:0:14270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14265:x1875815140793600:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788917076.550042:0:14270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14265:x1875815140793600:12345-0@lo:1000:mdt00_001.0 Request processed in 214us (458us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788917076.550050:0:14270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788917076.550118:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f326a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14265:1875815140793600:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788917076.550180:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83f073 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.550192:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83f073 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.550200:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83f073 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.550207:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18fc00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917076.550211:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83f073 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.550219:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83f073 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.550238:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:2.0:1788917076.550247:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788917076.550253:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83f073 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.550260:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18fc00/0x51de7f756a83f073 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.550288:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83efd2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.550295:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83efd2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.550302:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83efd2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.550307:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917076.550310:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83efd2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.550316:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83efd2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.550324:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:2.0:1788917076.550338:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788917076.550348:0:14265:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efd9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8faa2 expref: 18 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.550361:0:14265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efd9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8faa2 expref: 18 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.550372:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efd9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8faa2 expref: 18 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.550405:0:14265:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcabc00/0x51de7f756a83efd9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8faa2 expref: 18 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917076.550417:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f324000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14265:1875815140793728:192.168.202.40@tcp:105: 00000100:00100000:2.0:1788917076.550492:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e40b8fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788917076.554951:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917076.555037:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113564032 00000100:00100000:1.0:1788917076.555051:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113564032 00000100:00100000:1.0:1788917076.555190:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:1.0:1788917076.555203:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+19:14654:x1875815113564032:12345-192.168.202.40@tcp:49:bash.0 00000100:00100000:1.0:1788917076.555363:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+19:14654:x1875815113564032:12345-192.168.202.40@tcp:49:bash.0 Request processed in 163us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917076.555372:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:2.0:1788917076.555547:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f324000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14265:1875815140793728:192.168.202.40@tcp:105: 00010000:00010000:2.0:1788917076.555583:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83efd2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.555596:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f800/0x51de7f756a83efd2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.555633:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83f07a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.555651:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83f07a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.555665:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83f07a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.555676:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83f07a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.555683:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83f07a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.555690:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83f07a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.555722:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168f200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917076.555727:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83f07a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.555869:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83f07a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.555881:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:2.0:1788917076.555883:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917076.555886:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83f07a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.555890:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e0168f200/0x51de7f756a83f07a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.555901:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83f06c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.555905:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83f06c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.555909:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83f06c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.555912:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18e600 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917076.555914:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83f06c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.555917:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83f06c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.555935:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:2.0:1788917076.555938:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788917076.555941:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83f06c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.555946:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18e600/0x51de7f756a83f06c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917076.556194:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+18:14655:x1875815113563776:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 17436us (17645us total) trans 8589934665 rc 0/0 00000100:00100000:2.0:1788917076.556202:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 102 00000020:00080000:2.0:1788917076.556206:0:14265:0:(tgt_main.c:816:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788917076.556393:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917076.556399:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917076.556427:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788917076.556433:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917076.558692:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917076.558775:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113564160 00000100:00100000:1.0:1788917076.558788:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113564160 00000100:00100000:1.0:1788917076.558852:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:0.0:1788917076.559474:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.559535:0:14268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113564416 00000100:00100000:3.0:1788917076.559539:0:14268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113564416 00000100:00100000:3.0:1788917076.559620:0:14268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:3.0:1788917076.559629:0:14268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+18:14655:x1875815113564416:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788917076.559972:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:14654:x1875815113564160:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1788917076.559987:0:14901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788917076.560014:0:14901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3cb984b/0x51de7f756a83f081 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fad3 expref: -99 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.560050:0:14901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83f057 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8facc expref: 8 pid: 14903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.560058:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917076.560062:0:14901:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917076.560068:0:14901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3cb984b/0x51de7f756a83f081 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fad3 expref: 8 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.560117:0:14901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83f057 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8facc expref: 8 pid: 14903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.560129:0:14901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83f057 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8facc expref: 8 pid: 14903 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917076.560142:0:14901:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d156d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14901:1875815140793856:192.168.202.40@tcp:104: 00000100:00100000:1.0:1788917076.560246:0:14901:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06016840 going to sleep for 11 seconds 00000004:00080000:3.0:1788917076.560720:0:14268:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788917076.560825:0:14268:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934666 00010000:00010000:3.0:1788917076.560861:0:14268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83f088 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.560875:0:14268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83f088 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.560884:0:14268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83f088 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.560890:0:14268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83f088 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.560895:0:14268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83f088 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.560899:0:14268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83f088 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788917076.560954:0:14268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788917076.561036:0:14268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+20:14655:x1875815113564416:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 1408us (1561us total) trans 8589934667 rc 0/0 00000100:00100000:3.0:1788917076.561043:0:14268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000020:00080000:3.0:1788917076.561046:0:14268:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788917076.561712:0:14901:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d156d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14901:1875815140793856:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788917076.561742:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788917076.561752:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83f088 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.561759:0:14901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a3cb984b/0x51de7f756a83f081 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fad3 expref: 8 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.561763:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e2d18f600 already unused, calling callback (ffffffffc1729220) 00010000:00010000:1.0:1788917076.561783:0:14901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1e9d3000, rc 0) 00000100:00100000:1.0:1788917076.561830:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+8:14654:x1875815113564160:12345-192.168.202.40@tcp:101:bash.0 Request processed in 2969us (3148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917076.561838:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:2.0:1788917076.561974:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917076.562017:0:16404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113564544 00000100:00100000:1.0:1788917076.562026:0:16404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113564544 00010000:00010000:1.0:1788917076.562053:0:16404:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83f057 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8facc expref: 8 pid: 14903 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917076.562091:0:16404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:1.0:1788917076.562100:0:16404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+8:2374:x1875815113564544:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788917076.562118:0:16404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788917076.562138:0:16404:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83f057 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8facc expref: 8 pid: 14903 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.562164:0:16404:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83f057 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8facc expref: 8 pid: 14903 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.562183:0:16404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d707dcf/0x51de7f756a83f057 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8facc expref: 8 pid: 14903 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.562195:0:16404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917076.562199:0:16404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788917076.562205:0:16404:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3cb984b/0x51de7f756a83f081 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fad3 expref: 7 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.562212:0:16404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3cb984b/0x51de7f756a83f081 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fad3 expref: 7 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.562234:0:16404:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a3cb984b/0x51de7f756a83f081 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fad3 expref: 7 pid: 14901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917076.562244:0:16404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d156d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:16404:1875815140793984:192.168.202.40@tcp:105: 00010000:00010000:0.0:1788917076.562249:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83f088 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.562259:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83f088 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.562269:0:14254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9a6e02f3c000) 00010000:00010000:0.0:1788917076.562272:0:14254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788917076.562276:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83f088 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.562288:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e2d18f600/0x51de7f756a83f088 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14268 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917076.562295:0:16404:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06016840 going to sleep for 11 seconds 00010000:00010000:1.0:1788917076.563555:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917076.563561:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917076.563564:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917076.564865:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917076.564937:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113564800 00000100:00100000:3.0:1788917076.564945:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113564800 00000100:00100000:3.0:1788917076.564990:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:3.0:1788917076.564997:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+20:14654:x1875815113564800:12345-192.168.202.40@tcp:35:bash.0 00000001:00080000:3.0:1788917076.565302:0:14267:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934668 00000100:00100000:3.0:1788917076.565399:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+22:14654:x1875815113564800:12345-192.168.202.40@tcp:35:bash.0 Request processed in 402us (541us total) trans 8589934669 rc 0/0 00000100:00100000:3.0:1788917076.565405:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000020:00080000:3.0:1788917076.565410:0:14267:0:(tgt_main.c:816:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788917076.566067:0:16404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d156d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:16404:1875815140793984:192.168.202.40@tcp:105: 00010000:00010000:1.0:1788917076.566093:0:16404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788917076.566190:0:16404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f324000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:2374:x1875815113564544:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 4091us (4216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917076.566197:0:16404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:2.0:1788917076.598804:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917076.598930:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113564928 00000100:00100000:1.0:1788917076.598941:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113564928 00000100:00100000:1.0:1788917076.599013:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 103 00000100:00100000:1.0:1788917076.599025:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+22:14661:x1875815113564928:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1788917076.599069:0:16396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788917076.599097:0:16396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3a00/0x51de7f756a83f08f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fada expref: -99 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.599224:0:16396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83f096 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.599240:0:16396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83f096 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.599252:0:16396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83f096 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788917076.599521:0:16396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788917076.599525:0:16396:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788917076.599605:0:16396:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83f096 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.599634:0:16396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3a00/0x51de7f756a83f08f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fada expref: 24 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.599668:0:16396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d2200/0x51de7f756a83f096 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fada expref: 23 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.599677:0:16396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:1.0:1788917076.599680:0:16396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788917076.599684:0:16396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1e9d2200, rc 0) 00000100:00100000:1.0:1788917076.599762:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+23:14661:x1875815113564928:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 739us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917076.599770:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 103 00000100:00100000:2.0:1788917076.602387:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917076.602480:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113565056 00000100:00100000:0.0:1788917076.602490:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113565056 00000100:00100000:0.0:1788917076.602590:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 104 00000100:00100000:0.0:1788917076.602599:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+23:14661:x1875815113565056:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1788917076.602621:0:14266:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917076.602641:0:14266:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa200/0x51de7f756a83f09d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fae1 expref: -99 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.602696:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0a4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.602719:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0a4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.602739:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0a4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.602757:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.602762:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.602767:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603063:0:14266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83f0b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603079:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83f0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603085:0:14266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83f0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788917076.603117:0:14266:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 13 00000004:00200000:0.0:1788917076.603121:0:14266:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788917076.603138:0:14266:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83f0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603184:0:14266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83f0b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603190:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0a4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603194:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0a4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603199:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0a4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603203:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcab800 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917076.603206:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0a4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603211:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0a4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603221:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:0.0:1788917076.603227:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917076.603232:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603237:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603246:0:14266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603249:0:14266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0ab lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603253:0:14266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603256:0:14266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcaaa00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:0.0:1788917076.603257:0:14266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603261:0:14266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603264:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6e03d86a00) 00010000:00010000:0.0:1788917076.603266:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788917076.603267:0:14266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0ab lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603270:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14266 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603292:0:14266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa200/0x51de7f756a83f09d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fae1 expref: 25 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603310:0:14266:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83f0b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fae1 expref: 24 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.603317:0:14266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:0.0:1788917076.603320:0:14266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788917076.603322:0:14266:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e3bcaa000, rc 0) 00000100:00100000:0.0:1788917076.603393:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+24:14661:x1875815113565056:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 795us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917076.603401:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 104 00000100:00100000:2.0:1788917076.605647:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917076.605722:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113565312 00000100:00100000:1.0:1788917076.605744:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113565312 00000100:00100000:1.0:1788917076.605802:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 105 00000100:00100000:1.0:1788917076.605809:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+24:14661:x1875815113565312:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1788917076.605830:0:16396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788917076.605850:0:16396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3a00/0x51de7f756a83f0b9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8fae8 expref: -99 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.605937:0:16396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83f0c0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.605949:0:16396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83f0b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fae1 expref: 25 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.605955:0:16396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83f0c0 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.605987:0:16396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83f0b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fae1 expref: 25 pid: 14266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.606013:0:16396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83f0b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fae1 expref: 25 pid: 14266 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788917076.606025:0:16396:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d156d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16396:1875815140794112:192.168.202.40@tcp:104: 00000100:00100000:1.0:1788917076.606109:0:16396:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e06016840 going to sleep for 11 seconds 00000100:00100000:0.0:1788917076.607546:0:16396:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d156d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16396:1875815140794112:192.168.202.40@tcp:104: 00010000:00010000:0.0:1788917076.607578:0:16396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83f0c0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917076.607985:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917076.608036:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113565440 00000100:00100000:0.0:1788917076.608044:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113565440 00010000:00010000:0.0:1788917076.608082:0:14251:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83f0b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fae1 expref: 26 pid: 14266 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917076.608128:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:0.0:1788917076.608138:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+26:2373:x1875815113565440:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788917076.608198:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917076.608207:0:14251:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83f0b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fae1 expref: 26 pid: 14266 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.608222:0:14251:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83f0b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fae1 expref: 26 pid: 14266 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.608261:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83f0b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fae1 expref: 26 pid: 14266 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.608281:0:14251:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:0.0:1788917076.608285:0:14251:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83f0c0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.608292:0:14251:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83f0c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.608298:0:14251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83f0c0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.608328:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788917076.608383:0:16396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83f0c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917076.608384:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f325880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+25:2373:x1875815113565440:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 247us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917076.608398:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00010000:00010000:1.0:1788917076.608399:0:16396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83f0c0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788917076.608420:0:16396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788917076.608605:0:16396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3a00/0x51de7f756a83f0b9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fae8 expref: 26 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.608636:0:16396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83f0c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fae8 expref: 25 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788917076.608656:0:16396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:1.0:1788917076.608658:0:16396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788917076.608661:0:16396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e1e9d3600, rc 0) 00000100:00100000:1.0:1788917076.608705:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+25:14661:x1875815113565312:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 2895us (3065us total) trans 8589934670 rc 0/0 00000100:00100000:1.0:1788917076.608713:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 105 00000100:00100000:2.0:1788917076.623120:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917076.623358:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113565568 00000100:00100000:0.0:1788917076.623370:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113565568 00000100:00100000:0.0:1788917076.623446:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 106 00000100:00100000:0.0:1788917076.623459:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+25:14663:x1875815113565568:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1788917076.623493:0:14265:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788917076.623521:0:14265:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83f0ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x53cbce34a4e8faef expref: -99 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.623607:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa200/0x51de7f756a83f0d5 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.623647:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa200/0x51de7f756a83f0d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.623660:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa200/0x51de7f756a83f0d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.623680:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0dc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.623692:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.623700:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.624309:0:14265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.624321:0:14265:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83f0c0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fae8 expref: 26 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.624330:0:14265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0e3 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.624372:0:14265:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83f0c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fae8 expref: 26 pid: 16396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.624387:0:14265:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83f0c0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fae8 expref: 26 pid: 16396 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917076.624417:0:14265:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14265:1875815140794240:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917076.624521:0:14265:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e36cf6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788917076.626773:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917076.626919:0:14265:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14265:1875815140794240:192.168.202.40@tcp:104: 00000100:00100000:3.0:1788917076.626926:0:14267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113565824 00000100:00100000:3.0:1788917076.626936:0:14267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113565824 00010000:00010000:0.0:1788917076.626951:0:14265:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788917076.627000:0:14267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:3.0:1788917076.627011:0:14267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+27:13760:x1875815113565824:12345-192.168.202.40@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788917076.628419:0:14267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+28:13760:x1875815113565824:12345-192.168.202.40@tcp:35:ldlm_bl.0 Request processed in 1406us (1656us total) trans 8589934671 rc 0/0 00000100:00100000:3.0:1788917076.628430:0:14267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:3.0:1788917076.630005:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917076.630415:0:14252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113565952 00000100:00100000:0.0:1788917076.630425:0:14252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113565952 00010000:00010000:0.0:1788917076.630675:0:14252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83f0c0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fae8 expref: 28 pid: 16396 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917076.630763:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:0.0:1788917076.630773:0:14252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+28:2373:x1875815113565952:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788917076.630791:0:14252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917076.630798:0:14252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83f0c0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fae8 expref: 28 pid: 16396 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.630812:0:14252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83f0c0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fae8 expref: 28 pid: 16396 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.630840:0:14252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e1e9d3600/0x51de7f756a83f0c0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fae8 expref: 28 pid: 16396 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.630857:0:14252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:0.0:1788917076.630863:0:14252:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.630899:0:14252:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.630915:0:14252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0e3 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917076.630949:0:14252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788917076.631005:0:14252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+27:2373:x1875815113565952:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 233us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917076.631013:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00010000:00010000:2.0:1788917076.631119:0:14265:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631127:0:14265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788917076.631184:0:14265:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 13 00000004:00200000:2.0:1788917076.631188:0:14265:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788917076.631207:0:14265:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631228:0:14265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631239:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa200/0x51de7f756a83f0d5 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631246:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa200/0x51de7f756a83f0d5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631253:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa200/0x51de7f756a83f0d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631259:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcaa200 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917076.631264:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa200/0x51de7f756a83f0d5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631272:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa200/0x51de7f756a83f0d5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631281:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6e02f3c200) 00010000:00010000:2.0:1788917076.631284:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917076.631288:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa200/0x51de7f756a83f0d5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631295:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa200/0x51de7f756a83f0d5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631306:0:14265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0dc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631311:0:14265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0dc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631324:0:14265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631341:0:14265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e3bcaaa00 already unused, calling callback (ffffffffc21694f0) 00010000:00010000:2.0:1788917076.631344:0:14265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0dc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631351:0:14265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0dc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631360:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6e03d86a00) 00010000:00010000:2.0:1788917076.631362:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788917076.631365:0:14265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0dc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631371:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaaa00/0x51de7f756a83f0dc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14265 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631406:0:14265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcaa000/0x51de7f756a83f0ce lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8faef expref: 27 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631421:0:14265:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6e3bcab800/0x51de7f756a83f0e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8faef expref: 26 pid: 14265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917076.631429:0:14265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9a6e02cee000) 00010000:00010000:2.0:1788917076.631432:0:14265:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788917076.631435:0:14265:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6e3bcab800, rc 0) 00000100:00100000:2.0:1788917076.631462:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+26:14663:x1875815113565568:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 8007us (8355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917076.631479:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 106 00010000:00010000:3.0:1788917076.895296:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917077.167674:0:16490:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917077.167689:0:16490:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917077.167953:0:16490:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788917077.167964:0:16490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788917077.895884:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917077.895941:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917077.895984:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917077.896028:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917077.896051:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917077.896068:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917077.896093:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917077.896196:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113566464 00000100:00100000:3.0:1788917077.896210:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113566464 00000100:00100000:3.0:1788917077.896279:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113566720 00000100:00100000:3.0:1788917077.896282:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113566720 00000100:00100000:3.0:1788917077.896298:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113566336 00000100:00100000:3.0:1788917077.896300:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113566336 00000100:00100000:3.0:1788917077.896310:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113566848 00000100:00100000:3.0:1788917077.896312:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113566848 00000100:00100000:3.0:1788917077.896329:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:3.0:1788917077.896339:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+8:2373:x1875815113566464:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917077.896448:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+8:2373:x1875815113566464:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 111us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917077.896456:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:3.0:1788917077.896472:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:3.0:1788917077.896477:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3b8cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ef94afb-c48b-479f-853f-434eacee288c+5:2373:x1875815113566720:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917077.896498:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3b8cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ef94afb-c48b-479f-853f-434eacee288c+5:2373:x1875815113566720:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 21us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917077.896503:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:3.0:1788917077.896645:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:3.0:1788917077.896652:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:2373:x1875815113566336:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917077.896674:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:2373:x1875815113566336:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917077.896679:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:3.0:1788917077.896688:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:3.0:1788917077.896694:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ef94afb-c48b-479f-853f-434eacee288c+5:2373:x1875815113566848:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917077.896711:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f327480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5ef94afb-c48b-479f-853f-434eacee288c+5:2373:x1875815113566848:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 18us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917077.896728:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:3.0:1788917077.896749:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113566080 00000100:00100000:3.0:1788917077.896752:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113566080 00000100:00100000:3.0:1788917077.896780:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:3.0:1788917077.896786:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2373:x1875815113566080:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917077.896807:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2373:x1875815113566080:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 21us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917077.896819:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00080000:2.0:1788917077.897070:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788917077.897077:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788917077.897205:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113566208 00000100:00100000:1.0:1788917077.897211:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113566208 00000100:00100000:1.0:1788917077.897250:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113566592 00000100:00100000:1.0:1788917077.897254:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113566592 00000100:00100000:1.0:1788917077.897283:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:1.0:1788917077.897291:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+26:2373:x1875815113566208:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917077.897344:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+26:2373:x1875815113566208:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 54us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917077.897350:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:1.0:1788917077.897367:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:1.0:1788917077.897373:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113566592:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917077.897403:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113566592:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 30us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917077.897410:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00080000:2.0:1788917077.897509:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788917077.921109:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917078.559531:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140794368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788917078.559612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917078.559758:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140794368 00000100:00100000:2.0:1788917078.559768:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140794368 00000100:00100000:2.0:1788917078.559847:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788917078.559858:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875815140794368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788917078.559897:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788917078.559961:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917078.560460:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875815140794368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 602us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917078.560469:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788917078.560566:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140794368:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788917078.696483:0:16541:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917078.696493:0:16541:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917078.696541:0:16541:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788917078.696548:0:16541:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917078.943381:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917079.434902:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917079.435861:0:14906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113566976 00000100:00100000:1.0:1788917079.435875:0:14906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113566976 00002000:00100000:1.0:1788917079.436008:0:14906:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->12) req@ffff9a6e3f327800 x1875815113566976/t0(0) o4->92610db9-d8ec-4111-b657-7a2541e0ec4f@192.168.202.40@tcp:460/0 lens 504/0 e 0 to 0 dl 1788917090 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788917079.436021:0:14906:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e3f327800 with x1875815113566976 ext(0->12) 00002000:00010000:1.0:1788917079.436027:0:14906:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a6e3f327800 00000100:00100000:1.0:1788917079.436074:0:14906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:1.0:1788917079.436085:0:14906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+7:2373:x1875815113566976:12345-192.168.202.40@tcp:4:bash.0 00000100:00100000:1.0:1788917079.436800:0:14906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f327800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+9:2373:x1875815113566976:12345-192.168.202.40@tcp:4:bash.0 Request processed in 714us (1907us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788917079.436817:0:14906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00002000:00100000:1.0:1788917079.436825:0:14906:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->12) req@ffff9a6e3f327800 x1875815113566976/t8589934598(0) o4->92610db9-d8ec-4111-b657-7a2541e0ec4f@192.168.202.40@tcp:460/0 lens 504/448 e 0 to 0 dl 1788917090 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788917079.436835:0:14906:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6e3f327800 with x1875815113566976 ext(0->12) 00002000:00010000:1.0:1788917079.436839:0:14906:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a6e3f327800 00000100:00080000:3.0:1788917079.437989:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917079.438537:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917079.438613:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113567104 00000100:00100000:3.0:1788917079.438622:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113567104 00000100:00100000:3.0:1788917079.438728:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:3.0:1788917079.438738:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+9:2374:x1875815113567104:12345-192.168.202.40@tcp:16:kworker.0 00000001:00080000:2.0:1788917079.506836:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:2.0:1788917079.506864:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000100:00100000:0.0:1788917079.507090:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113567104:12345-192.168.202.40@tcp:16:kworker.0 Request processed in 68341us (68544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917079.507106:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00010000:00010000:3.0:1788917079.967750:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917080.294803:0:16592:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917080.294825:0:16592:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917080.294880:0:16592:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788917080.294887:0:16592:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788917080.607567:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140794496:0@lo:400:kworker.0 00000100:00100000:2.0:1788917080.607667:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917080.607672:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140794880:0@lo:400:kworker.0 00000004:00080000:3.0:1788917080.607853:0:14289:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 476639705129ns, next at 477639701966ns, rc = 0 00000100:00100000:3.0:1788917080.607888:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140794624:0@lo:400:kworker.0 00000100:00100000:1.0:1788917080.607916:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917080.607936:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917080.607945:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140795008:0@lo:400:kworker.0 00000100:00100000:1.0:1788917080.607968:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140794880 00000100:00100000:3.0:1788917080.607972:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140795136:0@lo:400:kworker.0 00000100:00100000:2.0:1788917080.607977:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917080.607978:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140794880 00000100:00100000:3.0:1788917080.608011:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917080.608024:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140794496 00000100:00100000:2.0:1788917080.608030:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140794496 00000100:00100000:2.0:1788917080.608067:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788917080.608075:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140794496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917080.608130:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140794496:12345-0@lo:400:kworker.0 Request processed in 55us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917080.608136:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788917080.608358:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788917080.608364:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140794752:0@lo:400:kworker.0 00000100:00100000:1.0:1788917080.608367:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140795008 00000100:00100000:1.0:1788917080.608373:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140795008 00000100:00100000:2.0:1788917080.608384:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140795136 00000100:00100000:3.0:1788917080.608389:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917080.608392:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140795136 00000100:00100000:3.0:1788917080.608412:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140795264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917080.608412:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788917080.608426:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140794880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917080.608435:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788917080.608447:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140795008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917080.608479:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c991180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140794880:12345-0@lo:400:kworker.0 Request processed in 56us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917080.608489:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788917080.608499:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140795008:12345-0@lo:400:kworker.0 Request processed in 52us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917080.608508:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788917080.608515:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788917080.608520:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140795136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917080.608560:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140795136:12345-0@lo:400:kworker.0 Request processed in 43us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917080.608567:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788917080.608604:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140795008:0@lo:400:kworker.0 00000100:00100000:1.0:1788917080.608615:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140794880:0@lo:400:kworker.0 00000100:00100000:2.0:1788917080.608622:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140794496:0@lo:400:kworker.0 00000100:00080000:2.0:1788917080.608657:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917080.608678:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140794624 00000100:00100000:2.0:1788917080.608681:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140794624 00000100:00100000:3.0:1788917080.608682:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140794752 00000100:00100000:3.0:1788917080.608686:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140794752 00000100:00100000:3.0:1788917080.608757:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788917080.608768:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875815140794752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917080.608772:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788917080.608784:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140794624:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788917080.608811:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788917080.608814:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875815140794752:12345-0@lo:400:kworker.0 Request processed in 49us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917080.608822:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788917080.608825:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788917080.608830:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140794624:12345-0@lo:400:kworker.0 Request processed in 49us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917080.608835:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788917080.608889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917080.608976:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788917080.608981:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788917080.608999:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140794624:0@lo:400:kworker.0 00000100:00100000:0.0:1788917080.609009:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140795264 00000100:00100000:0.0:1788917080.609015:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140795264 00000100:00100000:0.0:1788917080.609046:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788917080.609053:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875815140795264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788917080.609084:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917080.609132:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f325500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875815140795264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917080.609139:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788917080.609318:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140795136:0@lo:400:kworker.0 00000100:00100000:3.0:1788917080.609397:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140794752:0@lo:400:kworker.0 00000100:00100000:3.0:1788917080.609414:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140795264:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788917080.623800:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:2.0:1788917080.623826:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00010000:00010000:0.0:1788917080.991374:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788917081.664015:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934670 is committed 00000020:00080000:2.0:1788917081.664054:0:5814:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6e06e45540 refcount 2 committed 0 result 0 batchid 4294967528 00000020:00080000:2.0:1788917081.664061:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e37e39700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e06e45180 00000020:00080000:2.0:1788917081.664065:0:5814:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a6e37e39900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6e3f7b9000 00000004:00080000:2.0:1788917081.664090:0:5814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788917081.664107:0:5814:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934671 is committed 00000020:00080000:1.0:1788917081.664255:0:14303:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967528 committed batchid 8 00000020:00080000:1.0:1788917081.664629:0:14303:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788917081.664676:0:5814:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000100:00100000:2.0:1788917081.664848:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788917081.664874:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140795392:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788917081.664957:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917081.665043:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140795392 00000100:00100000:2.0:1788917081.665051:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140795392 00000100:00100000:2.0:1788917081.665108:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788917081.665119:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03855180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140795392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788917081.665450:0:16200:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:34 count 1 00010000:00010000:2.0:1788917081.665492:0:16200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83f0ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917081.665520:0:16200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e4cf588/0x51de7f756a83eeba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa5c expref: 5 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917081.665530:0:16200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1788917081.665535:0:16200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788917081.665541:0:16200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83f0ea lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917081.665579:0:16200:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e4cf588/0x51de7f756a83eeba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa5c expref: 5 pid: 14900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917081.665596:0:16200:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e4cf588/0x51de7f756a83eeba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa5c expref: 5 pid: 14900 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788917081.665610:0:16200:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16200:1875815140795520:192.168.202.40@tcp:104: 00000100:00100000:2.0:1788917081.665932:0:16200:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a6e3b16b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788917081.670428:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917081.670493:0:14251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113567232 00000100:00100000:2.0:1788917081.670506:0:16200:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16200:1875815140795520:192.168.202.40@tcp:104: 00000100:00100000:0.0:1788917081.670509:0:14251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113567232 00010000:00010000:2.0:1788917081.670550:0:16200:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83f0ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917081.670581:0:14251:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e4cf588/0x51de7f756a83eeba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa5c expref: 6 pid: 14900 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917081.670615:0:14251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00080000:1.0:1788917081.670994:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788917081.671760:0:14251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3c491c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2373:x1875815113567232:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788917081.671779:0:14251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788917081.671786:0:14251:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e4cf588/0x51de7f756a83eeba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa5c expref: 6 pid: 14900 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917081.671798:0:14251:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e4cf588/0x51de7f756a83eeba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa5c expref: 6 pid: 14900 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917081.671819:0:14251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e4cf588/0x51de7f756a83eeba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.40@tcp remote: 0x53cbce34a4e8fa5c expref: 6 pid: 14900 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917081.671832:0:14251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788917081.671835:0:14251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788917081.671839:0:14251:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83f0ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917081.671846:0:14251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83f0ea lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 16200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917081.671872:0:14251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788917081.671906:0:16200:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83f0ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917081.671937:0:16200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83f0ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788917081.671947:0:14251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3c491c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+5:2373:x1875815113567232:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 1321us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917081.671969:0:14251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00010000:00010000:2.0:1788917081.671970:0:16200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83f0ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917081.671984:0:16200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83f0ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788917081.672018:0:16200:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788917081.672192:0:14254:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788917081.672199:0:14254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83f0ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917081.672206:0:14254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6e0168fc00 already unused, calling callback (ffffffffc1729220) 00010000:00010000:0.0:1788917081.672209:0:14254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83f0ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917081.672217:0:14254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83f0ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917081.672227:0:14254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83f0ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917081.672233:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7476e65/0x51de7f756a83f0ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788917081.672247:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917081.672249:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917081.672250:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917081.672888:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03855180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140795392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7768us (7928us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788917081.672899:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788917081.672938:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934599 gen 2 00000004:00080000:0.0:1788917081.672944:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934599 committed transno 8589934599 00000100:00100000:0.0:1788917081.672964:0:3307:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9a6e3f326a00 x1875815140795392/t8589934601(8589934601) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788917097 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788917081.672985:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6e3f326a00/2, rc 0, transno 8589934601 00000100:00100000:0.0:1788917081.672989:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140795392:0@lo:6:osp-syn-1-0.0 00000040:00080000:0.0:1788917081.855761:0:16644:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917081.855768:0:16644:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917081.855814:0:16644:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788917081.855820:0:16644:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788917082.015732:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917083.015904:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917083.015969:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917083.015995:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917083.016026:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917083.016027:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113567488 00000100:00100000:2.0:1788917083.016039:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113567488 00000100:00100000:0.0:1788917083.016046:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917083.016063:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917083.016085:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917083.016100:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113567872 00000100:00100000:2.0:1788917083.016103:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113567872 00000100:00100000:0.0:1788917083.016109:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:0.0:1788917083.016119:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113567488:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917083.016125:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:2.0:1788917083.016131:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2374:x1875815113567872:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917083.016217:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2374:x1875815113567872:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 86us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917083.016225:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:1.0:1788917083.016235:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113567744 00000100:00100000:1.0:1788917083.016240:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113567744 00000100:00100000:2.0:1788917083.016246:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113567616 00000100:00100000:2.0:1788917083.016248:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113567616 00000100:00100000:2.0:1788917083.016263:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113568000 00000100:00100000:1.0:1788917083.016263:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113568128 00000100:00100000:1.0:1788917083.016265:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113568128 00000100:00100000:2.0:1788917083.016277:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113568000 00000100:00100000:1.0:1788917083.016280:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:1.0:1788917083.016285:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113567616:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917083.016292:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:2.0:1788917083.016297:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+5:2373:x1875815113567744:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917083.017901:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113567360 00000100:00100000:3.0:1788917083.017912:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113567360 00000100:00100000:3.0:1788917083.017965:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00100000:3.0:1788917083.017973:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113567360:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917083.018073:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113567488:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 1954us (2100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917083.018082:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:0.0:1788917083.018164:0:16200:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788917083.018174:0:16200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788917083.018268:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113567616:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 1980us (2238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917083.018276:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:1.0:1788917083.018292:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:1.0:1788917083.018302:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ef94afb-c48b-479f-853f-434eacee288c+5:2374:x1875815113568128:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917083.018341:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ef94afb-c48b-479f-853f-434eacee288c+5:2374:x1875815113568128:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 42us (2255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917083.018347:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:1.0:1788917083.018361:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:1.0:1788917083.018367:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ef94afb-c48b-479f-853f-434eacee288c+5:2373:x1875815113568000:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917083.018392:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ef94afb-c48b-479f-853f-434eacee288c+5:2373:x1875815113568000:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (2344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917083.018398:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00080000:0.0:1788917083.018837:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788917083.018842:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788917083.018846:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917083.019616:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113567360:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 1641us (3717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917083.019624:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00100000:2.0:1788917083.020052:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+5:2373:x1875815113567744:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 2330us (2632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917083.020064:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00010000:00010000:0.0:1788917083.039467:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917083.331494:0:16697:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917083.331564:0:16697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917083.331616:0:16697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788917083.331623:0:16697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917083.681064:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788917083.681093:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140795648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917083.681212:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917083.681398:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140795648 00000100:00100000:2.0:1788917083.681407:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140795648 00000100:00100000:2.0:1788917083.681491:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788917083.681501:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c993b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140795648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788917083.681541:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917083.681593:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c993b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140795648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917083.681601:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788917083.681729:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917083.681769:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140795648:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788917084.063292:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917084.929821:0:16749:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917084.929835:0:16749:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917084.929907:0:16749:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788917084.929914:0:16749:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788917085.087705:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917085.728020:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140795776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917085.728114:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917085.728268:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140795776 00000100:00100000:0.0:1788917085.728279:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140795776 00000100:00100000:0.0:1788917085.728359:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788917085.728370:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875815140795776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788917085.728415:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917085.728468:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875815140795776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917085.728476:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788917085.728532:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140795776:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788917085.728664:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788917085.728919:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788917085.728927:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140795904:0@lo:400:kworker.0 00000100:00100000:0.0:1788917085.728963:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917085.729010:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788917085.729018:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140796032:0@lo:400:kworker.0 00000100:00100000:0.0:1788917085.729047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917085.729083:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140796160:0@lo:400:kworker.0 00000100:00100000:0.0:1788917085.729109:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917085.729162:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140796288:0@lo:400:kworker.0 00000100:00100000:0.0:1788917085.729184:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917085.729209:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140796160 00000100:00100000:0.0:1788917085.729213:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140796160 00000100:00100000:0.0:1788917085.729240:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140796288 00000100:00100000:0.0:1788917085.729242:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140796288 00000100:00100000:1.0:1788917085.729253:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140796032 00000100:00100000:1.0:1788917085.729257:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140796032 00000100:00100000:0.0:1788917085.729266:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788917085.729273:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140796160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917085.729285:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788917085.729291:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140796032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917085.729362:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140795904 00000100:00100000:2.0:1788917085.729366:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140795904 00000100:00080000:3.0:1788917085.729367:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788917085.729371:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917085.729395:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788917085.729396:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788917085.729402:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140795904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917085.729403:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140796288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917085.729438:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140796288:12345-0@lo:400:kworker.0 Request processed in 36us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917085.729444:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788917085.729444:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140796160:12345-0@lo:400:kworker.0 Request processed in 52us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917085.729455:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788917085.729773:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140795904:12345-0@lo:400:kworker.0 Request processed in 371us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917085.729780:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788917085.730628:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140796032:12345-0@lo:400:kworker.0 Request processed in 1334us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917085.730638:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788917085.730757:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140796416:0@lo:400:kworker.0 00000100:00100000:1.0:1788917085.730805:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917085.730845:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140796416 00000100:00100000:1.0:1788917085.730850:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140796416 00000100:00100000:1.0:1788917085.730890:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788917085.730897:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140796416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917085.730935:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140796416:12345-0@lo:400:kworker.0 Request processed in 39us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917085.730941:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788917085.730974:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c992300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140796416:0@lo:400:kworker.0 00000100:00080000:1.0:1788917085.731010:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917085.731504:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140796288:0@lo:400:kworker.0 00000100:00100000:3.0:1788917085.731518:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140795904:0@lo:400:kworker.0 00000100:00100000:0.0:1788917085.732413:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140796160:0@lo:400:kworker.0 00000100:00100000:0.0:1788917085.732434:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140796032:0@lo:400:kworker.0 00000001:00080000:0.0:1788917085.758674:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000040:00080000:0.0:1788917085.791488:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917085.791501:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917085.791544:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788917085.791552:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917086.111485:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917086.456627:0:16801:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917086.456652:0:16801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917086.456711:0:16801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788917086.456717:0:16801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000020:00080000:0.0:1788917086.778397:0:5814:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967528 batchid updated 00000020:00080000:1.0:1788917086.778462:0:14303:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000020:00080000:1.0:1788917086.778480:0:14303:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00010000:00010000:0.0:1788917087.135378:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917087.933382:0:16853:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917087.933394:0:16853:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917087.933444:0:16853:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788917087.933451:0:16853:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917088.137964:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917088.137998:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917088.138029:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917088.138048:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113568256 00000100:00100000:3.0:1788917088.138065:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113568256 00000100:00100000:2.0:1788917088.138080:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113568512 00000100:00100000:2.0:1788917088.138091:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113568512 00000100:00100000:1.0:1788917088.138128:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917088.138189:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:3.0:1788917088.138203:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2371:x1875815113568256:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917088.138214:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:2.0:1788917088.138230:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2371:x1875815113568512:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917088.138312:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c992300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2371:x1875815113568512:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 85us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917088.138329:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2371:x1875815113568256:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 126us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917088.138337:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:3.0:1788917088.138350:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:1.0:1788917088.138455:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00080000:3.0:1788917088.138461:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788917088.138494:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113568640 00000100:00100000:3.0:1788917088.138499:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113568640 00000100:00100000:3.0:1788917088.138541:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1788917088.138549:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c992d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+5:2371:x1875815113568640:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917088.138585:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c992d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+5:2371:x1875815113568640:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 36us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917088.138591:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00080000:3.0:1788917088.138610:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788917088.138719:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113568384 00000100:00100000:0.0:1788917088.138719:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113568768 00000100:00100000:2.0:1788917088.138726:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113568384 00000100:00100000:0.0:1788917088.138727:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113568768 00000100:00100000:0.0:1788917088.138821:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:0.0:1788917088.138829:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:2371:x1875815113568768:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917088.138871:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c993100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:2371:x1875815113568768:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 43us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917088.138879:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00080000:3.0:1788917088.139341:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917088.139463:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:3.0:1788917088.139471:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2371:x1875815113568384:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917088.139560:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2371:x1875815113568384:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 89us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917088.139582:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00080000:0.0:1788917088.139663:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917088.142123:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917088.142204:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917088.142412:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113568896 00000100:00100000:3.0:1788917088.142424:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113568896 00000100:00100000:3.0:1788917088.142548:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113569024 00000100:00100000:3.0:1788917088.142551:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113569024 00000100:00100000:2.0:1788917088.142582:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:2.0:1788917088.142593:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ef94afb-c48b-479f-853f-434eacee288c+5:2370:x1875815113568896:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:2.0:1788917088.142642:0:14900:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83ead8 00000100:00080000:2.0:1788917088.142666:0:14900:0:(import.c:65:import_set_state_nolock()) ffff9a6e36bab800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788917088.142714:0:14900:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:2.0:1788917088.143360:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c993480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5ef94afb-c48b-479f-853f-434eacee288c+2:2370:x1875815113568896:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 768us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917088.143369:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00010000:00010000:2.0:1788917088.143397:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788917088.144412:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788917088.144419:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788917088.144883:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:3.0:1788917088.144894:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5ef94afb-c48b-479f-853f-434eacee288c+5:2370:x1875815113569024:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:3.0:1788917088.144923:0:16665:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83eadf 00000100:00080000:3.0:1788917088.144947:0:16665:0:(import.c:65:import_set_state_nolock()) ffff9a6e36bad800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788917088.144992:0:16665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00010000:00010000:1.0:1788917088.145342:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917088.145493:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5ef94afb-c48b-479f-853f-434eacee288c+2:2370:x1875815113569024:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 600us (3286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917088.145502:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 32 00010000:00010000:0.0:1788917088.161464:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917088.799467:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788917088.799507:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140796544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788917088.799592:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917088.799833:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140796544 00000100:00100000:2.0:1788917088.799842:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140796544 00000100:00100000:2.0:1788917088.800024:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788917088.800034:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140796544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788917088.800078:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917088.800140:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140796544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917088.800170:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788917088.800688:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917088.801318:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140796544:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788917089.183456:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917089.401268:0:16904:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917089.401276:0:16904:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917089.401470:0:16904:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788917089.401479:0:16904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00100000:3.0:1788917089.843836:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5ef94afb-c48b-479f-853f-434eacee288c 00000020:00000080:3.0:1788917089.843845:0:6617:0:(genops.c:907:class_export_put()) final put ffff9a6e36ba8800/5ef94afb-c48b-479f-853f-434eacee288c 00000020:00000080:2.0:1788917089.843968:0:38:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e36ba8800/5ef94afb-c48b-479f-853f-434eacee288c for lustre-OST0000 00000020:00000080:2.0:1788917089.844024:0:38:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e36bab800 for lustre-OST0000 00010000:00010000:1.0:1788917090.208320:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917090.830214:0:16957:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917090.830224:0:16957:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917090.830291:0:16957:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788917090.830298:0:16957:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917090.847310:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140796672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917090.847385:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917090.847428:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140796672 00000100:00100000:2.0:1788917090.847441:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140796672 00000100:00100000:2.0:1788917090.847521:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788917090.847534:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140796672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788917090.847590:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917090.847680:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140796672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917090.847686:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788917090.847708:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788917090.847775:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 2 00000004:00080000:3.0:1788917090.847782:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6e3f326a00, transno 8589934601 00000100:00100000:3.0:1788917090.847839:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140796672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917090.848760:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140796800:0@lo:400:kworker.0 00000100:00100000:3.0:1788917090.848810:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140796928:0@lo:400:kworker.0 00000100:00100000:1.0:1788917090.848810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917090.848850:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140797312:0@lo:400:kworker.0 00000100:00100000:3.0:1788917090.848868:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917090.848884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917090.848927:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140797312 00000100:00100000:1.0:1788917090.848934:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140797312 00000100:00100000:3.0:1788917090.848946:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140796928 00000100:00100000:3.0:1788917090.848954:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140796928 00000100:00100000:1.0:1788917090.849003:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788917090.849008:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788917090.849015:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140796928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917090.849023:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140797312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917090.849054:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140796928:12345-0@lo:400:kworker.0 Request processed in 39us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917090.849060:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788917090.849082:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140797056:0@lo:400:kworker.0 00000100:00100000:1.0:1788917090.849100:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c992680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140797312:12345-0@lo:400:kworker.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917090.849113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917090.849120:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788917090.849139:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788917090.849170:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140797184:0@lo:400:kworker.0 00000100:00100000:1.0:1788917090.849177:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140797056 00000100:00100000:1.0:1788917090.849184:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140797056 00000100:00100000:3.0:1788917090.849190:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917090.849223:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140797184 00000100:00100000:3.0:1788917090.849228:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788917090.849231:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140797184 00000100:00100000:3.0:1788917090.849236:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140797056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917090.849276:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140797056:12345-0@lo:400:kworker.0 Request processed in 39us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917090.849279:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788917090.849291:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788917090.849298:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140797184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917090.849321:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140797056:0@lo:400:kworker.0 00000100:00100000:3.0:1788917090.849350:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140796928:0@lo:400:kworker.0 00000100:00100000:1.0:1788917090.849369:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140797184:12345-0@lo:400:kworker.0 Request processed in 73us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917090.849378:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788917090.849402:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140797184:0@lo:400:kworker.0 00000100:00100000:1.0:1788917090.849440:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140797312:0@lo:400:kworker.0 00000100:00100000:2.0:1788917090.849526:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140796800 00000100:00100000:2.0:1788917090.849532:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140796800 00000100:00100000:2.0:1788917090.849568:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788917090.849576:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140796800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917090.849626:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140796800:12345-0@lo:400:kworker.0 Request processed in 52us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917090.849630:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1788917090.849651:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788917090.849654:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917090.849667:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140796800:0@lo:400:kworker.0 00000001:00100000:0.0:1788917090.871159:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5ef94afb-c48b-479f-853f-434eacee288c 00000020:00000080:0.0:1788917090.871171:0:7503:0:(genops.c:907:class_export_put()) final put ffff9a6e36baf000/5ef94afb-c48b-479f-853f-434eacee288c 00000020:00000080:3.0:1788917090.871205:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e36baf000/5ef94afb-c48b-479f-853f-434eacee288c for lustre-OST0001 00000020:00000080:3.0:1788917090.871269:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e36bad800 for lustre-OST0001 00010000:00010000:0.0:1788917091.231442:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917092.255289:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917092.259669:0:17013:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917092.259679:0:17013:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917092.259726:0:17013:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788917092.259732:0:17013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917093.263778:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917093.263863:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917093.263901:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917093.263934:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917093.263961:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917093.264010:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113569280 00000100:00100000:0.0:1788917093.264020:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113569664 00000100:00100000:1.0:1788917093.264022:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113569280 00000100:00100000:0.0:1788917093.264028:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113569664 00000100:00100000:2.0:1788917093.264110:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113569536 00000100:00100000:2.0:1788917093.264115:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113569536 00000100:00100000:1.0:1788917093.264216:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:1.0:1788917093.264230:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2374:x1875815113569280:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917093.264316:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2374:x1875815113569280:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 89us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917093.264326:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:1.0:1788917093.264465:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113569408 00000100:00100000:1.0:1788917093.264469:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113569408 00000100:00100000:3.0:1788917093.264887:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113569152 00000100:00100000:3.0:1788917093.264893:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113569152 00000100:00100000:3.0:1788917093.264928:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:3.0:1788917093.264935:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2373:x1875815113569152:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917093.264991:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2373:x1875815113569152:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 56us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917093.264999:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:2.0:1788917093.266803:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:0.0:1788917093.266803:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:0.0:1788917093.266823:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113569664:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917093.266825:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+5:2374:x1875815113569536:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917093.266955:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:1.0:1788917093.266965:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c991c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2373:x1875815113569408:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917093.267091:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+5:2374:x1875815113569536:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 274us (3187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917093.267099:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00080000:3.0:1788917093.267345:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788917093.267351:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788917093.267355:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917093.268044:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113569664:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 1226us (4078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917093.268054:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:1.0:1788917093.268532:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c991c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2373:x1875815113569408:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 1566us (4594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917093.268542:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00010000:00010000:1.0:1788917093.279964:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917093.732413:0:17064:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917093.732422:0:17064:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917093.732468:0:17064:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788917093.732474:0:17064:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788917093.919745:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140797440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788917093.919832:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917093.920883:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140797440 00000100:00100000:3.0:1788917093.920895:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140797440 00000100:00100000:3.0:1788917093.921030:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788917093.921040:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140797440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788917093.921079:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788917093.921167:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140797440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917093.921175:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788917093.921360:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917093.921721:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140797440:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788917094.303302:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917095.008433:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917095.008442:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917095.008481:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788917095.008487:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:1.0:1788917095.203273:0:17115:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917095.203281:0:17115:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917095.203329:0:17115:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788917095.203336:0:17115:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788917095.327455:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917095.968054:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140797568:0@lo:400:kworker.0 00000100:00100000:0.0:1788917095.968213:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140797824:0@lo:400:kworker.0 00000100:00100000:3.0:1788917095.968231:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917095.968256:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917095.968328:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788917095.968336:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140797952:0@lo:400:kworker.0 00000100:00100000:2.0:1788917095.968342:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140797568 00000100:00100000:2.0:1788917095.968352:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140797568 00000100:00100000:0.0:1788917095.968364:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917095.968404:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788917095.968408:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140797824 00000100:00100000:0.0:1788917095.968413:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140797824 00000100:00100000:1.0:1788917095.968415:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788917095.968416:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140797568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917095.968427:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140798336:0@lo:400:kworker.0 00000100:00100000:0.0:1788917095.968461:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140797952 00000100:00100000:0.0:1788917095.968465:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140797952 00000100:00100000:1.0:1788917095.968468:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917095.968478:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140797568:12345-0@lo:400:kworker.0 Request processed in 64us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917095.968487:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788917095.968492:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788917095.968497:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140798336 00000100:00100000:1.0:1788917095.968500:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140798336 00000100:00100000:0.0:1788917095.968500:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140797824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917095.968526:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3f326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140797696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917095.968541:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f325880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140797824:12345-0@lo:400:kworker.0 Request processed in 41us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917095.968545:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788917095.968548:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788917095.968564:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140798336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917095.968575:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788917095.968576:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917095.968584:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140797952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917095.968605:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140798208:0@lo:400:kworker.0 00000100:00100000:1.0:1788917095.968613:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140798336:12345-0@lo:400:kworker.0 Request processed in 59us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917095.968613:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140797952:12345-0@lo:400:kworker.0 Request processed in 31us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917095.968620:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788917095.968636:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788917095.968637:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788917095.968644:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788917095.968647:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917095.968661:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788917095.968668:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140798080:0@lo:400:kworker.0 00000100:00100000:0.0:1788917095.968679:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140798208 00000100:00100000:0.0:1788917095.968684:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140798208 00000100:00100000:2.0:1788917095.968694:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917095.968716:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140798080 00000100:00100000:0.0:1788917095.968720:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140798080 00000100:00100000:2.0:1788917095.968728:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140797696 00000100:00100000:2.0:1788917095.968734:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140797696 00000100:00100000:0.0:1788917095.968738:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788917095.968747:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140798208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917095.968768:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788917095.968777:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140797696:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917095.968788:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140798208:12345-0@lo:400:kworker.0 Request processed in 43us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917095.968795:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00002000:00000024:2.0:1788917095.968807:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917095.968817:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788917095.968825:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140798080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917095.968845:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140797696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917095.968853:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788917095.968864:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140798080:12345-0@lo:400:kworker.0 Request processed in 39us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917095.968871:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788917095.968889:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917095.968901:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140797568:0@lo:400:kworker.0 00000100:00100000:2.0:1788917095.968913:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140798080:0@lo:400:kworker.0 00000100:00100000:0.0:1788917095.968914:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140797952:0@lo:400:kworker.0 00000100:00100000:0.0:1788917095.968932:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140797824:0@lo:400:kworker.0 00000100:00100000:2.0:1788917095.968944:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3f326a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140797696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788917095.968958:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140798208:0@lo:400:kworker.0 00000100:00100000:0.0:1788917095.968969:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140798336:0@lo:400:kworker.0 00000100:00100000:1.0:1788917095.969237:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1788917096.352301:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917096.704629:0:17166:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917096.704638:0:17166:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917096.704682:0:17166:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788917096.704688:0:17166:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917097.375365:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917098.353787:0:17218:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917098.353799:0:17218:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917098.353849:0:17218:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788917098.353855:0:17218:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917098.383739:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917098.383794:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917098.383875:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113569920 00000100:00100000:2.0:1788917098.383887:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113569920 00000100:00100000:2.0:1788917098.383964:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:2.0:1788917098.383976:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2371:x1875815113569920:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:3.0:1788917098.384191:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917098.386377:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2371:x1875815113569920:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 2390us (2640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917098.386393:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:1.0:1788917098.386626:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917098.386976:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917098.387012:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917098.387042:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113570176 00000100:00100000:1.0:1788917098.387053:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113570176 00000100:00100000:1.0:1788917098.387109:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113570048 00000100:00100000:1.0:1788917098.387113:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113570048 00000100:00100000:1.0:1788917098.387139:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:1.0:1788917098.387177:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+5:2371:x1875815113570176:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917098.387238:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+5:2371:x1875815113570176:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 64us (3445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917098.387251:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:1.0:1788917098.387268:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:1.0:1788917098.387275:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2372:x1875815113570048:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:3.0:1788917098.387294:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788917098.387301:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788917098.387307:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2372:x1875815113570048:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 32us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917098.387314:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:1.0:1788917098.387338:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113570304 00000100:00100000:1.0:1788917098.387342:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113570304 00000100:00100000:1.0:1788917098.387378:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:1.0:1788917098.387385:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2372:x1875815113570304:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:3.0:1788917098.387405:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917098.387415:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2372:x1875815113570304:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 29us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917098.387423:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:2.0:1788917098.387954:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113569792 00000100:00100000:2.0:1788917098.387961:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113569792 00000100:00100000:2.0:1788917098.388003:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 126 00000100:00100000:2.0:1788917098.388011:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2372:x1875815113569792:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917098.388044:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2372:x1875815113569792:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 34us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917098.388051:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 126 00010000:00010000:3.0:1788917098.404167:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917099.039401:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140798464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788917099.039487:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917099.039558:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140798464 00000100:00100000:2.0:1788917099.039569:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140798464 00000100:00080000:1.0:1788917099.039617:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917099.039712:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788917099.039726:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140798464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788917099.039770:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917099.039831:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140798464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917099.039839:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788917099.039931:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140798464:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788917099.423604:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917099.876175:0:17269:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917099.876183:0:17269:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917099.876225:0:17269:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788917099.876230:0:17269:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917100.447549:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917101.088241:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140798720:0@lo:400:kworker.0 00000100:00100000:2.0:1788917101.088302:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917101.088342:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140799232:0@lo:400:kworker.0 00000100:00100000:2.0:1788917101.088359:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917101.088375:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788917101.088378:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140798592:0@lo:400:kworker.0 00000100:00100000:2.0:1788917101.088397:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917101.088409:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140799104:0@lo:400:kworker.0 00000100:00100000:2.0:1788917101.088422:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917101.088441:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140799232 00000100:00100000:2.0:1788917101.088448:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140799232 00000100:00100000:2.0:1788917101.088483:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140799104 00000100:00100000:2.0:1788917101.088484:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140799104 00000100:00100000:2.0:1788917101.088496:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788917101.088502:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140799232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917101.088562:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140799232:12345-0@lo:400:kworker.0 Request processed in 59us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917101.088569:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788917101.088584:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788917101.088591:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140799104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917101.088618:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140799104:12345-0@lo:400:kworker.0 Request processed in 28us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917101.088624:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788917101.088662:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140799104:0@lo:400:kworker.0 00000100:00100000:2.0:1788917101.088671:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140799232:0@lo:400:kworker.0 00000100:00080000:1.0:1788917101.088811:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917101.088843:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140798976:0@lo:400:kworker.0 00000100:00100000:1.0:1788917101.088884:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917101.088910:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788917101.088916:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140798848:0@lo:400:kworker.0 00000100:00100000:1.0:1788917101.088939:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917101.088955:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140799360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917101.088978:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917101.089008:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140799360 00000100:00100000:1.0:1788917101.089012:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140799360 00000100:00100000:1.0:1788917101.089053:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788917101.089059:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140799360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788917101.089088:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917101.089135:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140799360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917101.089142:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788917101.089185:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788917101.089207:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140799360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917101.089232:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140798592 00000100:00100000:1.0:1788917101.089234:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140798592 00000100:00100000:1.0:1788917101.089254:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788917101.089257:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140798592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917101.089281:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140798592:12345-0@lo:400:kworker.0 Request processed in 24us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917101.089286:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788917101.089313:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140798592:0@lo:400:kworker.0 00000100:00100000:1.0:1788917101.089353:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140798720 00000100:00100000:1.0:1788917101.089356:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140798720 00000100:00100000:1.0:1788917101.089383:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140798848 00000100:00100000:1.0:1788917101.089385:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140798848 00000100:00100000:1.0:1788917101.089401:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788917101.089406:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140798720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917101.089433:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140798720:12345-0@lo:400:kworker.0 Request processed in 28us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917101.089438:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788917101.089445:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788917101.089453:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140798848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917101.089474:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140798848:12345-0@lo:400:kworker.0 Request processed in 20us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917101.089477:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788917101.089495:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917101.089524:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140798720:0@lo:400:kworker.0 00000100:00100000:1.0:1788917101.089546:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140798848:0@lo:400:kworker.0 00000100:00100000:2.0:1788917101.089672:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140798976 00000100:00100000:2.0:1788917101.089676:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140798976 00000100:00100000:2.0:1788917101.089700:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788917101.089706:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140798976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917101.089739:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140798976:12345-0@lo:400:kworker.0 Request processed in 34us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917101.089745:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788917101.089812:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140798976:0@lo:400:kworker.0 00000040:00080000:1.0:1788917101.318992:0:17321:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917101.319003:0:17321:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917101.319052:0:17321:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788917101.319060:0:17321:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788917101.471391:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917102.495539:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917102.811396:0:17373:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917102.811410:0:17373:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917102.811458:0:17373:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788917102.811466:0:17373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788917103.495260:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917103.495340:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113570432 00000100:00100000:0.0:1788917103.495353:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113570432 00000100:00100000:0.0:1788917103.495498:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:0.0:1788917103.495511:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113570432:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917103.495622:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113570432:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 113us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917103.495630:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:3.0:1788917103.495667:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917103.495747:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113570560 00000100:00100000:2.0:1788917103.495752:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113570560 00000100:00100000:2.0:1788917103.495798:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:2.0:1788917103.495806:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2374:x1875815113570560:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917103.495842:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2374:x1875815113570560:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 38us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917103.495848:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00080000:2.0:1788917103.495907:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917103.496693:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917103.496765:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113570688 00000100:00100000:1.0:1788917103.496771:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113570688 00000100:00100000:3.0:1788917103.496880:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:3.0:1788917103.496893:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113570688:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:2.0:1788917103.496903:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788917103.496951:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113570688:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 62us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917103.497196:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:1.0:1788917103.502715:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917103.502899:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917103.503032:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113570816 00000100:00100000:2.0:1788917103.503044:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113570816 00000100:00100000:2.0:1788917103.503129:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:2.0:1788917103.503140:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+5:2370:x1875815113570816:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:2.0:1788917103.503211:0:16200:0:(genops.c:1497:class_disconnect()) disconnect: cookie 0x51de7f756a83eaa7 00000100:00080000:2.0:1788917103.503223:0:16200:0:(import.c:65:import_set_state_nolock()) ffff9a6e1ea0f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788917103.503274:0:16200:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00010000:00010000:0.0:1788917103.503589:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917103.503622:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+2:2370:x1875815113570816:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 483us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917103.503655:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00080000:1.0:1788917103.503758:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788917103.504241:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113570944 00000100:00100000:3.0:1788917103.504249:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113570944 00000100:00100000:3.0:1788917103.504357:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:3.0:1788917103.504366:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113570944:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917103.504431:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113570944:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 66us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917103.504438:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00080000:1.0:1788917103.504695:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788917103.519964:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917104.160537:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140799488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917104.160633:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917104.161018:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140799488 00000100:00100000:2.0:1788917104.161027:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140799488 00000100:00080000:1.0:1788917104.161077:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917104.161108:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788917104.161120:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140799488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788917104.161200:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917104.161315:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140799488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 197us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917104.161324:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788917104.161355:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140799488:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788917104.303465:0:17424:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917104.303490:0:17424:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917104.303546:0:17424:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788917104.303554:0:17424:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917104.543348:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917105.248002:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917105.248012:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917105.248114:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788917105.248122:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917105.567389:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917105.824279:0:17476:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917105.824289:0:17476:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917105.824337:0:17476:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788917105.824343:0:17476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917106.207379:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140799616:0@lo:400:kworker.0 00000100:00100000:2.0:1788917106.207428:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140799744:0@lo:400:kworker.0 00000100:00100000:1.0:1788917106.207508:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3bdd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140800000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917106.207550:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140799872:0@lo:400:kworker.0 00000100:00100000:2.0:1788917106.208773:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917106.208783:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917106.208845:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140800256:0@lo:400:kworker.0 00000100:00100000:2.0:1788917106.208878:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917106.208889:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140800128:0@lo:400:kworker.0 00000100:00100000:2.0:1788917106.208916:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140799744 00000100:00100000:3.0:1788917106.208921:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917106.208924:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140799744 00000100:00100000:3.0:1788917106.208976:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140800256 00000100:00100000:2.0:1788917106.208980:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788917106.208982:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140800256 00000100:00100000:0.0:1788917106.209014:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917106.209017:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140800128 00000100:00100000:3.0:1788917106.209021:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140800128 00000100:00100000:0.0:1788917106.209037:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140800384:0@lo:400:kworker.0 00000100:00100000:3.0:1788917106.209044:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788917106.209054:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140800256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917106.209064:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917106.209091:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140799872 00000100:00100000:0.0:1788917106.209096:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140799872 00000100:00100000:3.0:1788917106.209111:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140800256:12345-0@lo:400:kworker.0 Request processed in 57us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917106.209128:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788917106.209139:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140799744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917106.209166:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140800384 00000100:00100000:1.0:1788917106.209167:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917106.209172:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140800384 00000100:00100000:3.0:1788917106.209198:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788917106.209207:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140800128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917106.209210:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140799744:12345-0@lo:400:kworker.0 Request processed in 74us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917106.209217:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140799616 00000100:00100000:1.0:1788917106.209222:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140799616 00000100:00100000:3.0:1788917106.209250:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140800128:12345-0@lo:400:kworker.0 Request processed in 46us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917106.209260:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788917106.209261:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788917106.209275:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140799616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917106.209275:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788917106.209280:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788917106.209286:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140799872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917106.209293:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140800384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917106.209330:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140799616:12345-0@lo:400:kworker.0 Request processed in 59us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917106.209339:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788917106.209344:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140800384:12345-0@lo:400:kworker.0 Request processed in 52us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917106.209352:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140799872:12345-0@lo:400:kworker.0 Request processed in 66us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917106.209356:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788917106.209366:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788917106.209380:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140800000 00000100:00100000:1.0:1788917106.209386:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140800000 00000100:00100000:1.0:1788917106.209418:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788917106.209427:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140800000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788917106.209468:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917106.209512:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140799872:0@lo:400:kworker.0 00000100:00100000:1.0:1788917106.209517:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140800000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917106.209526:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788917106.209532:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140800384:0@lo:400:kworker.0 00000100:00100000:1.0:1788917106.209579:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3bdd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140800000:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788917106.209589:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788917106.209594:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788917106.209597:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917106.209638:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140800256:0@lo:400:kworker.0 00000100:00100000:1.0:1788917106.209655:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140799744:0@lo:400:kworker.0 00000100:00100000:1.0:1788917106.209718:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d089500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140800128:0@lo:400:kworker.0 00000100:00100000:1.0:1788917106.209730:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140799616:0@lo:400:kworker.0 00000100:00100000:2.0:1788917106.211338:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000001:00100000:1.0:1788917106.224605:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 92610db9-d8ec-4111-b657-7a2541e0ec4f 00000020:00000080:1.0:1788917106.224615:0:7503:0:(genops.c:907:class_export_put()) final put ffff9a6e1ea0a800/92610db9-d8ec-4111-b657-7a2541e0ec4f 00000020:00000080:1.0:1788917106.224646:0:36:0:(genops.c:866:class_export_destroy()) destroying export ffff9a6e1ea0a800/92610db9-d8ec-4111-b657-7a2541e0ec4f for lustre-OST0001 00000020:00000080:1.0:1788917106.224687:0:36:0:(genops.c:1205:obd_zombie_import_free()) destroying import ffff9a6e1ea0f000 for lustre-OST0001 00010000:00010000:3.0:1788917106.591390:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917107.357787:0:17528:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917107.357797:0:17528:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917107.357839:0:17528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788917107.357847:0:17528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917107.615682:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917108.617628:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917108.617707:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917108.617733:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917108.617767:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113571072 00000100:00100000:0.0:1788917108.617785:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113571072 00000100:00100000:0.0:1788917108.617837:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 130 00000100:00100000:0.0:1788917108.617848:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2371:x1875815113571072:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917108.617926:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2371:x1875815113571072:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917108.617934:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 130 00000100:00100000:3.0:1788917108.618366:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917108.618390:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113571328 00000100:00100000:3.0:1788917108.618394:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113571328 00000100:00100000:3.0:1788917108.618451:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:3.0:1788917108.618459:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2371:x1875815113571328:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917108.618501:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2371:x1875815113571328:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 43us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917108.618508:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:2.0:1788917108.620387:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113571200 00000100:00100000:2.0:1788917108.620395:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113571200 00000100:00100000:0.0:1788917108.620849:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113571456 00000100:00100000:0.0:1788917108.620854:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113571456 00000100:00100000:0.0:1788917108.620889:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:0.0:1788917108.620898:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2372:x1875815113571200:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917108.620961:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2372:x1875815113571200:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 65us (3344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917108.620968:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:0.0:1788917108.620981:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:0.0:1788917108.620987:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:2372:x1875815113571456:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917108.621010:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:2372:x1875815113571456:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (3276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917108.621016:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00080000:0.0:1788917108.621041:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788917108.621046:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788917108.639238:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917108.808226:0:17579:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917108.808237:0:17579:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917108.808271:0:17579:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788917108.808276:0:17579:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788917109.279349:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788917109.279680:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140800512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788917109.279783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917109.282676:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140800512 00000100:00100000:1.0:1788917109.282696:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140800512 00000100:00100000:1.0:1788917109.282806:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788917109.282816:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917109.282820:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140800512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788917109.282876:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917109.282963:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140800512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (3179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917109.282972:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788917109.283015:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140800512:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788917109.663366:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917110.196936:0:17630:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917110.196946:0:17630:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917110.196995:0:17630:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788917110.197000:0:17630:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917110.687497:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917111.327344:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140800896:0@lo:400:kworker.0 00000100:00100000:1.0:1788917111.327441:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140800640:0@lo:400:kworker.0 00000100:00100000:0.0:1788917111.327448:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917111.327505:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917111.327538:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788917111.327542:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140801152:0@lo:400:kworker.0 00000100:00100000:0.0:1788917111.327558:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140801024:0@lo:400:kworker.0 00000100:00100000:1.0:1788917111.327577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917111.327728:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788917111.327739:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140801408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917111.327753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917111.327760:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788917111.327780:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140800768:0@lo:400:kworker.0 00000100:00100000:3.0:1788917111.327781:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917111.327806:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140800896 00000100:00100000:0.0:1788917111.327815:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140800896 00000100:00100000:1.0:1788917111.327821:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917111.327829:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140801408 00000100:00100000:3.0:1788917111.327834:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140801408 00000100:00100000:1.0:1788917111.327847:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140801280:0@lo:400:kworker.0 00000100:00100000:1.0:1788917111.327871:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917111.327890:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788917111.327900:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140800768 00000100:00100000:3.0:1788917111.327905:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c991500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140801408:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917111.327906:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140800768 00000100:00100000:1.0:1788917111.327907:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140800640 00000100:00100000:1.0:1788917111.327914:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140800640 00000100:00100000:0.0:1788917111.327950:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00002000:00000024:3.0:1788917111.327952:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917111.327958:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788917111.327963:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1875815140800896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917111.327973:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140800640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917111.328008:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c991500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140801408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917111.328019:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788917111.328032:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1875815140800896:12345-0@lo:400:kworker.0 Request processed in 72us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917111.328035:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140800640:12345-0@lo:400:kworker.0 Request processed in 65us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917111.328045:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788917111.328049:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788917111.328085:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140801152 00000100:00100000:1.0:1788917111.328089:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140801152 00000100:00100000:1.0:1788917111.328119:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140801024 00000100:00100000:1.0:1788917111.328122:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140801024 00000100:00100000:1.0:1788917111.328134:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140801280 00000100:00100000:1.0:1788917111.328137:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140801280 00000100:00100000:1.0:1788917111.328175:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788917111.328183:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140801152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917111.328215:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140801152:12345-0@lo:400:kworker.0 Request processed in 33us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917111.328222:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788917111.328309:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788917111.328316:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140801024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917111.328347:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140801024:12345-0@lo:400:kworker.0 Request processed in 32us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917111.328353:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788917111.328373:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788917111.328379:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140801280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917111.328388:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788917111.328401:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140800768:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788917111.328421:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917111.328427:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140801280:12345-0@lo:400:kworker.0 Request processed in 45us (552us total) trans 0 rc 0/0 00000100:00080000:0.0:1788917111.328428:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788917111.328432:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788917111.328439:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788917111.328465:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140800768:12345-0@lo:400:kworker.0 Request processed in 66us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917111.328473:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788917111.328485:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140801024:0@lo:400:kworker.0 00000100:00100000:0.0:1788917111.328506:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140800896:0@lo:400:kworker.0 00000100:00100000:3.0:1788917111.328512:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140801408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917111.328575:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140800768:0@lo:400:kworker.0 00000100:00100000:3.0:1788917111.328588:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140801280:0@lo:400:kworker.0 00000100:00100000:3.0:1788917111.328597:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140800640:0@lo:400:kworker.0 00000100:00100000:3.0:1788917111.328611:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140801152:0@lo:400:kworker.0 00000040:00080000:0.0:1788917111.678863:0:17681:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917111.678876:0:17681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917111.678924:0:17681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788917111.678980:0:17681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917111.718900:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917112.737648:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917113.174210:0:17733:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917113.174220:0:17733:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917113.174270:0:17733:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788917113.174276:0:17733:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788917113.742806:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917113.742857:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917113.742896:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917113.742937:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917113.742973:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113571840 00000100:00100000:0.0:1788917113.742984:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113571840 00000100:00100000:1.0:1788917113.743000:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113571712 00000100:00100000:1.0:1788917113.743006:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113571712 00000100:00100000:3.0:1788917113.743031:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113571584 00000100:00100000:3.0:1788917113.743037:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113571584 00000100:00100000:2.0:1788917113.743070:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113571968 00000100:00100000:2.0:1788917113.743075:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113571968 00000100:00100000:3.0:1788917113.743096:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 132 00000100:00100000:3.0:1788917113.743110:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2372:x1875815113571584:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917113.743131:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:0.0:1788917113.743141:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2372:x1875815113571840:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917113.743238:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2372:x1875815113571840:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 99us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917113.743246:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:3.0:1788917113.743618:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2372:x1875815113571584:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 511us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917113.743625:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 132 00000100:00100000:2.0:1788917113.746575:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:2.0:1788917113.746595:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2372:x1875815113571968:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917113.746718:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2372:x1875815113571968:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 128us (3859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917113.746726:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:2.0:1788917113.746752:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:2.0:1788917113.746760:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2372:x1875815113571712:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917113.746788:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2372:x1875815113571712:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 29us (3993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917113.746796:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00080000:0.0:1788917113.747709:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788917113.747719:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788917113.760458:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917114.400270:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788917114.400294:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140801536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788917114.400363:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917114.400559:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140801536 00000100:00100000:3.0:1788917114.400566:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140801536 00000100:00080000:1.0:1788917114.400612:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788917114.400633:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788917114.400643:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140801536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788917114.400685:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788917114.400742:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c990e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140801536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917114.400748:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788917114.400846:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140801536:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788917114.659823:0:17784:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917114.659837:0:17784:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917114.659889:0:17784:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788917114.659898:0:17784:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917114.783565:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917115.487492:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917115.487503:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917115.487542:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788917115.487549:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917115.809272:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917116.137673:0:17835:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917116.137684:0:17835:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917116.137733:0:17835:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788917116.137740:0:17835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788917116.447378:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3bdd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140801664:0@lo:400:kworker.0 00000100:00100000:1.0:1788917116.447416:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3bdd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140801920:0@lo:400:kworker.0 00000100:00100000:2.0:1788917116.447515:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3bdd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140801792:0@lo:400:kworker.0 00000100:00100000:1.0:1788917116.447849:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917116.447849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917116.447918:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3bdd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140802176:0@lo:400:kworker.0 00000100:00100000:3.0:1788917116.447919:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140801664 00000100:00100000:3.0:1788917116.447930:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140801664 00000100:00100000:0.0:1788917116.447952:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917116.447991:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788917116.448003:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140801664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917116.448074:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140801664:12345-0@lo:400:kworker.0 Request processed in 73us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917116.448084:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788917116.448093:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140802432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917116.448122:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917116.448167:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788917116.448175:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3bdd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140802048:0@lo:400:kworker.0 00000100:00100000:3.0:1788917116.448176:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140802176 00000100:00100000:3.0:1788917116.448182:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140802176 00000100:00100000:1.0:1788917116.448203:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917116.448232:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140802048 00000100:00100000:3.0:1788917116.448237:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140802048 00000100:00100000:1.0:1788917116.448244:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140802432 00000100:00100000:1.0:1788917116.448250:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140802432 00000100:00100000:3.0:1788917116.448266:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788917116.448286:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140802176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917116.448291:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788917116.448302:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140802432:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917116.448320:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140801920 00000100:00100000:0.0:1788917116.448324:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140801920 00000100:00100000:3.0:1788917116.448333:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140802176:12345-0@lo:400:kworker.0 Request processed in 49us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917116.448341:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00002000:00000024:1.0:1788917116.448344:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788917116.448373:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788917116.448375:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788917116.448386:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140802048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917116.448394:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1875815140801920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917116.448399:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875815140802432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917116.448406:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788917116.448428:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788917116.448429:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140802048:12345-0@lo:400:kworker.0 Request processed in 47us (225us total) trans 0 rc 0/0 00000100:00080000:1.0:1788917116.448434:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917116.448441:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788917116.448442:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140801920:12345-0@lo:400:kworker.0 Request processed in 49us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917116.448451:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788917116.448479:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3bdd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140802048:0@lo:400:kworker.0 00000100:00100000:3.0:1788917116.448495:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3bdd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140802176:0@lo:400:kworker.0 00000100:00100000:1.0:1788917116.448502:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140802432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917116.448511:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3bdd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140801664:0@lo:400:kworker.0 00000100:00100000:1.0:1788917116.448519:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3bdd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140801920:0@lo:400:kworker.0 00000100:00100000:2.0:1788917116.448613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917116.448641:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3bdd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140802304:0@lo:400:kworker.0 00000100:00100000:2.0:1788917116.448665:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917116.448699:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140801792 00000100:00100000:0.0:1788917116.448703:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140801792 00000100:00100000:1.0:1788917116.448729:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140802304 00000100:00100000:1.0:1788917116.448733:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140802304 00000100:00100000:1.0:1788917116.448776:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788917116.448783:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140802304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917116.448796:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788917116.448803:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140801792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917116.448824:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140802304:12345-0@lo:400:kworker.0 Request processed in 41us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917116.448831:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788917116.448834:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140801792:12345-0@lo:400:kworker.0 Request processed in 34us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917116.448840:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788917116.448909:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788917116.448913:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788917116.448937:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3bdd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140801792:0@lo:400:kworker.0 00000100:00100000:3.0:1788917116.448948:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3bdd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140802304:0@lo:400:kworker.0 00010000:00010000:1.0:1788917116.831400:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917117.545457:0:17887:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917117.545467:0:17887:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917117.545515:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788917117.545522:0:17887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917117.855830:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917118.855204:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917118.855283:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113572096 00000100:00100000:3.0:1788917118.855297:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113572096 00000100:00100000:1.0:1788917118.855360:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917118.855377:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00100000:3.0:1788917118.855391:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113572096:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917118.855407:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917118.855436:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113572224 00000100:00100000:2.0:1788917118.855448:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113572224 00000100:00100000:3.0:1788917118.855481:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113572096:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 93us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917118.855497:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00100000:2.0:1788917118.855521:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:2.0:1788917118.855533:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113572224:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:3.0:1788917118.855536:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917118.855577:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113572224:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 47us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917118.855586:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:3.0:1788917118.855808:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917118.855849:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113572480 00000100:00100000:1.0:1788917118.855854:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113572480 00000100:00100000:1.0:1788917118.855907:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:1.0:1788917118.855915:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113572480:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917118.855956:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113572480:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 41us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917118.855971:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:0.0:1788917118.856003:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113572352 00000100:00100000:0.0:1788917118.856009:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113572352 00000100:00100000:0.0:1788917118.856054:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:0.0:1788917118.856061:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113572352:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917118.856095:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113572352:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 35us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917118.856100:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00080000:3.0:1788917118.856424:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788917118.856428:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788917118.879375:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917118.957239:0:17938:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917118.957255:0:17938:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917118.957304:0:17938:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788917118.957314:0:17938:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917119.519475:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140802560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917119.519546:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917119.519728:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140802560 00000100:00100000:3.0:1788917119.519736:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140802560 00000100:00100000:3.0:1788917119.519826:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788917119.519835:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140802560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788917119.519886:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788917119.519945:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140802560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917119.519952:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788917119.520033:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140802560:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788917119.520109:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788917119.904599:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917120.387199:0:17990:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917120.387209:0:17990:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917120.387258:0:17990:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788917120.387264:0:17990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917120.927305:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917121.567450:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a7d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140802944:0@lo:400:kworker.0 00000100:00100000:1.0:1788917121.567528:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917121.567589:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788917121.567595:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a7d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140803072:0@lo:400:kworker.0 00000100:00100000:1.0:1788917121.567630:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917121.567666:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140802944 00000100:00100000:1.0:1788917121.567674:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140802944 00000100:00100000:1.0:1788917121.567726:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788917121.567735:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140802944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917121.567784:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140802944:12345-0@lo:400:kworker.0 Request processed in 51us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917121.567798:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788917121.567823:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140803072 00000100:00100000:1.0:1788917121.567827:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140803072 00000100:00100000:1.0:1788917121.567851:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788917121.567856:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140803072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917121.567884:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140803072:12345-0@lo:400:kworker.0 Request processed in 28us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917121.567901:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788917121.567916:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788917121.567961:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a7d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140803072:0@lo:400:kworker.0 00000100:00100000:1.0:1788917121.567971:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a7d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140802944:0@lo:400:kworker.0 00000100:00100000:0.0:1788917121.568062:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a7d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140802688:0@lo:400:kworker.0 00000100:00100000:2.0:1788917121.568083:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a7d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140802816:0@lo:400:kworker.0 00000100:00100000:0.0:1788917121.568100:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917121.568122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917121.568138:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140803200:0@lo:400:kworker.0 00000100:00100000:2.0:1788917121.568175:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a7d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140803328:0@lo:400:kworker.0 00000100:00100000:0.0:1788917121.568185:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917121.568212:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917121.568232:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140803200 00000100:00100000:0.0:1788917121.568236:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140803200 00000100:00100000:2.0:1788917121.568327:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140803328 00000100:00100000:2.0:1788917121.568331:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140803328 00000100:00100000:2.0:1788917121.568460:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788917121.568469:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140803200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917121.568502:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140802688 00000100:00100000:1.0:1788917121.568507:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140802688 00000100:00100000:2.0:1788917121.568513:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140803200:12345-0@lo:400:kworker.0 Request processed in 45us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917121.568522:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788917121.568541:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788917121.568546:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788917121.568551:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140803328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917121.568558:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140802688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917121.568596:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140803328:12345-0@lo:400:kworker.0 Request processed in 47us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917121.568604:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788917121.568608:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140802688:12345-0@lo:400:kworker.0 Request processed in 51us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917121.568617:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788917121.568637:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a7d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140803328:0@lo:400:kworker.0 00000100:00100000:1.0:1788917121.568651:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140802816 00000100:00100000:1.0:1788917121.568655:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140802816 00000100:00100000:2.0:1788917121.568680:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a7d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140802688:0@lo:400:kworker.0 00000100:00100000:1.0:1788917121.568691:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788917121.568696:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140803200:0@lo:400:kworker.0 00000100:00100000:1.0:1788917121.568702:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140802816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917121.568747:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140802816:12345-0@lo:400:kworker.0 Request processed in 48us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917121.568754:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788917121.568766:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a7d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140802816:0@lo:400:kworker.0 00000100:00080000:1.0:1788917121.568774:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788917121.568780:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917121.569066:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788917121.569077:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140803456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917121.569107:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917121.569541:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140803456 00000100:00100000:3.0:1788917121.569547:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140803456 00000100:00100000:3.0:1788917121.569669:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788917121.569678:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140803456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788917121.569707:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788917121.569753:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140803456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917121.569759:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788917121.570210:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140803456:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788917121.872309:0:18041:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917121.872643:0:18041:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917121.872712:0:18041:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788917121.872717:0:18041:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917121.951236:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917122.977432:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917123.321472:0:18092:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917123.321482:0:18092:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917123.321534:0:18092:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788917123.321541:0:18092:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917123.976790:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917123.976844:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917123.976888:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917123.976926:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113572736 00000100:00100000:3.0:1788917123.976938:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917123.976938:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113572736 00000100:00100000:1.0:1788917123.977013:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113572992 00000100:00100000:3.0:1788917123.977014:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113572864 00000100:00100000:1.0:1788917123.977017:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113572992 00000100:00100000:3.0:1788917123.977020:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113572864 00000100:00100000:1.0:1788917123.977051:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:1.0:1788917123.977064:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2372:x1875815113572736:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917123.977070:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:3.0:1788917123.977081:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2372:x1875815113572864:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917123.977192:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:2.0:1788917123.977202:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:2372:x1875815113572992:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917123.977209:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2372:x1875815113572864:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 127us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917123.977215:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2372:x1875815113572736:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 151us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917123.977224:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:1.0:1788917123.977231:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:2.0:1788917123.977243:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:2372:x1875815113572992:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 41us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917123.977252:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:0.0:1788917123.977252:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113572608 00000100:00100000:0.0:1788917123.977259:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113572608 00000100:00080000:1.0:1788917123.977263:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788917123.977270:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917123.977314:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 136 00000100:00100000:0.0:1788917123.977324:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2372:x1875815113572608:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917123.977358:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2372:x1875815113572608:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 38us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917123.977365:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 136 00010000:00010000:1.0:1788917123.999486:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917124.640450:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788917124.640484:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3bdd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140803584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917124.640580:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917124.640768:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140803584 00000100:00100000:3.0:1788917124.640779:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140803584 00000100:00100000:3.0:1788917124.640887:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788917124.640899:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140803584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788917124.640952:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788917124.641012:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140803584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917124.641020:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788917124.641052:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3bdd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140803584:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788917124.641060:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788917124.796094:0:18143:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917124.796107:0:18143:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917124.796267:0:18143:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788917124.796274:0:18143:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917125.025111:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917125.729220:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917125.729237:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917125.729296:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788917125.729304:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917126.047363:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917126.257322:0:18195:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917126.257336:0:18195:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917126.257388:0:18195:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788917126.257395:0:18195:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917126.687470:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788917126.687535:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788917126.687557:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a7d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140803840:0@lo:400:kworker.0 00000100:00100000:2.0:1788917126.687632:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917126.687745:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140803968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788917126.687777:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917126.687838:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140803968 00000100:00100000:2.0:1788917126.687846:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140803968 00000100:00100000:2.0:1788917126.687911:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788917126.687918:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140803968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788917126.687960:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917126.687996:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140803968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917126.688001:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788917126.688044:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140803968:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788917126.688564:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788917126.688576:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140803840 00000100:00100000:2.0:1788917126.688580:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140803840 00000100:00100000:2.0:1788917126.688609:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788917126.688613:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140803840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917126.688650:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140803840:12345-0@lo:400:kworker.0 Request processed in 37us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917126.688655:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788917126.688672:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917126.688688:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a7d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140803840:0@lo:400:kworker.0 00000100:00100000:3.0:1788917126.689222:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a7d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140803712:0@lo:400:kworker.0 00000100:00100000:3.0:1788917126.689292:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917126.689438:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140803712 00000100:00100000:2.0:1788917126.689444:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140803712 00000100:00100000:2.0:1788917126.689562:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788917126.689570:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140803712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917126.689623:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f286c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140803712:12345-0@lo:400:kworker.0 Request processed in 43us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917126.689630:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788917126.689789:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a7d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140803712:0@lo:400:kworker.0 00000100:00100000:2.0:1788917126.690177:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a7d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140804096:0@lo:400:kworker.0 00000100:00100000:2.0:1788917126.690212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917126.690287:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140804096 00000100:00100000:3.0:1788917126.690293:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140804096 00000100:00100000:1.0:1788917126.690307:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a7d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140804224:0@lo:400:kworker.0 00000100:00100000:3.0:1788917126.690338:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788917126.690343:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917126.690349:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140804096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917126.690379:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140804224 00000100:00100000:2.0:1788917126.690384:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140804224 00000100:00100000:3.0:1788917126.690401:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140804096:12345-0@lo:400:kworker.0 Request processed in 53us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917126.690408:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788917126.690413:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788917126.690428:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a7d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140804352:0@lo:400:kworker.0 00000100:00100000:3.0:1788917126.690443:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a7d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140804096:0@lo:400:kworker.0 00000100:00100000:1.0:1788917126.690458:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788917126.690477:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917126.690494:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140804352 00000100:00100000:3.0:1788917126.690499:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788917126.690499:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140804352 00000100:00100000:3.0:1788917126.690510:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140804224:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788917126.690531:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917126.690542:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788917126.690550:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140804352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917126.690557:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140804224:12345-0@lo:400:kworker.0 Request processed in 47us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917126.690564:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788917126.690572:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a7d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140804224:0@lo:400:kworker.0 00000100:00100000:2.0:1788917126.690590:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a7d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140804352:0@lo:400:kworker.0 00000100:00100000:1.0:1788917126.690591:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140804352:12345-0@lo:400:kworker.0 Request processed in 43us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917126.690597:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:1.0:1788917127.071400:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917127.713276:0:18246:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917127.713286:0:18246:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917127.713332:0:18246:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788917127.713338:0:18246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917128.095634:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917129.095411:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917129.095451:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917129.095952:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917129.096011:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917129.096049:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113573376 00000100:00100000:1.0:1788917129.096060:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113573376 00000100:00100000:1.0:1788917129.096136:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:1.0:1788917129.096172:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2372:x1875815113573376:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917129.096277:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2372:x1875815113573376:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 131us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917129.096287:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:0.0:1788917129.096565:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113573120 00000100:00100000:0.0:1788917129.096572:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113573120 00000100:00100000:0.0:1788917129.096616:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00100000:0.0:1788917129.096624:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2371:x1875815113573120:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917129.096664:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2371:x1875815113573120:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 41us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917129.096670:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00100000:2.0:1788917129.096809:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113573248 00000100:00100000:2.0:1788917129.096814:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113573248 00000100:00100000:2.0:1788917129.096858:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113573504 00000100:00100000:2.0:1788917129.096862:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113573504 00000100:00100000:2.0:1788917129.096898:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:2.0:1788917129.096906:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2371:x1875815113573248:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917129.096947:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2371:x1875815113573248:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 42us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917129.096955:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:2.0:1788917129.096969:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:2.0:1788917129.096975:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2372:x1875815113573504:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917129.097000:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2372:x1875815113573504:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917129.097007:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00080000:2.0:1788917129.097028:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788917129.097033:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788917129.117044:0:18297:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917129.117056:0:18297:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917129.117105:0:18297:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788917129.117112:0:18297:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917129.119378:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917129.759494:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788917129.759631:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3bdd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140804480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788917129.759747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917129.759806:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140804480 00000100:00100000:3.0:1788917129.759817:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140804480 00000100:00080000:2.0:1788917129.759875:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788917129.759907:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788917129.759919:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140804480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788917129.759967:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788917129.760029:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140804480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917129.760037:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788917129.760086:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3bdd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140804480:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788917130.143430:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917130.496703:0:18348:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917130.496713:0:18348:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917130.496777:0:18348:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788917130.496785:0:18348:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917131.167344:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917131.808411:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3bdd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140804608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788917131.808494:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917131.808637:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140804608 00000100:00100000:1.0:1788917131.808647:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140804608 00000100:00100000:1.0:1788917131.808759:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788917131.808769:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140804608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788917131.808805:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917131.809171:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140804736:0@lo:400:kworker.0 00000100:00100000:0.0:1788917131.809204:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917131.809238:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140805248:0@lo:400:kworker.0 00000100:00100000:0.0:1788917131.809277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917131.809298:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788917131.809303:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140804864:0@lo:400:kworker.0 00000100:00100000:0.0:1788917131.809321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917131.809504:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140805248 00000100:00100000:0.0:1788917131.809509:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140805248 00000100:00080000:3.0:1788917131.810311:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788917131.810321:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788917131.810336:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140804864 00000100:00100000:3.0:1788917131.810342:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140804864 00000100:00100000:3.0:1788917131.810398:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788917131.810408:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140804864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917131.810482:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140804864:12345-0@lo:400:kworker.0 Request processed in 76us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917131.810490:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788917131.810519:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140804992:0@lo:400:kworker.0 00000100:00100000:3.0:1788917131.810553:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917131.810581:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788917131.810587:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140805120:0@lo:400:kworker.0 00000100:00100000:3.0:1788917131.810610:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917131.810637:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140804992 00000100:00100000:3.0:1788917131.810641:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140804992 00000100:00100000:3.0:1788917131.810667:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140805120 00000100:00100000:3.0:1788917131.810670:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140805120 00000100:00100000:3.0:1788917131.810685:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788917131.810691:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140804992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917131.810725:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140804992:12345-0@lo:400:kworker.0 Request processed in 34us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917131.810742:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788917131.810755:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788917131.810761:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140805120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917131.810789:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140805120:12345-0@lo:400:kworker.0 Request processed in 28us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917131.810795:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788917131.810831:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140805120:0@lo:400:kworker.0 00000100:00100000:3.0:1788917131.810841:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140804992:0@lo:400:kworker.0 00000100:00100000:3.0:1788917131.810870:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140804864:0@lo:400:kworker.0 00000100:00080000:3.0:1788917131.810884:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788917131.810887:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788917131.810932:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140804736 00000100:00100000:3.0:1788917131.810936:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140804736 00000100:00100000:3.0:1788917131.810969:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788917131.810975:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140804736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917131.811010:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140804736:12345-0@lo:400:kworker.0 Request processed in 35us (1805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917131.811017:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788917131.811050:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140804736:0@lo:400:kworker.0 00000100:00100000:1.0:1788917131.812287:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140804608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3515us (3788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917131.812293:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3bdd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140804608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917131.812302:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788917131.812546:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788917131.812555:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140805248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917131.812614:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140805248:12345-0@lo:400:kworker.0 Request processed in 60us (3335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917131.812621:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788917131.812702:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140805248:0@lo:400:kworker.0 00000040:00080000:1.0:1788917131.927828:0:18399:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917131.927837:0:18399:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917131.927891:0:18399:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788917131.927899:0:18399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917132.191905:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917133.215328:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917133.353010:0:18451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917133.353019:0:18451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917133.353061:0:18451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788917133.353071:0:18451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917134.215808:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917134.215918:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917134.216255:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113573632 00000100:00100000:0.0:1788917134.216264:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113573632 00000100:00100000:0.0:1788917134.216310:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 140 00000100:00100000:0.0:1788917134.216319:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113573632:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917134.216384:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113573632:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 67us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917134.216390:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 140 00000100:00100000:3.0:1788917134.216929:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113573760 00000100:00100000:3.0:1788917134.216934:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113573760 00000100:00080000:2.0:1788917134.216994:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917134.217009:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:3.0:1788917134.217024:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113573760:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917134.217075:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113573760:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 54us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917134.217082:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:1.0:1788917134.217213:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917134.217244:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113574016 00000100:00100000:1.0:1788917134.217245:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917134.217250:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113574016 00000100:00100000:2.0:1788917134.217350:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113573888 00000100:00100000:2.0:1788917134.217354:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113573888 00000100:00100000:0.0:1788917134.217414:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 74 00000100:00100000:0.0:1788917134.217422:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113574016:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917134.217460:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113574016:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 38us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917134.217467:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 74 00000100:00080000:3.0:1788917134.217675:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788917134.217679:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917134.217775:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:2.0:1788917134.217784:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113573888:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917134.217825:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113573888:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 43us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917134.217832:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 48 00010000:00010000:2.0:1788917134.239405:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917134.857993:0:18502:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917134.858001:0:18502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917134.858050:0:18502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788917134.858056:0:18502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917134.880361:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788917134.880384:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3bdd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140805376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788917134.880460:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917134.880651:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140805376 00000100:00100000:2.0:1788917134.880660:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140805376 00000100:00100000:2.0:1788917134.880769:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788917134.880780:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140805376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788917134.880818:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917134.880887:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140805376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917134.880895:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788917134.880989:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3bdd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140805376:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788917134.881023:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788917135.263582:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917135.967411:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917135.967421:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917135.967462:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788917135.967468:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917136.287292:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917136.313218:0:18553:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917136.313230:0:18553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917136.313281:0:18553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788917136.313289:0:18553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788917136.927630:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140805888:0@lo:400:kworker.0 00000100:00100000:1.0:1788917136.927642:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140805760:0@lo:400:kworker.0 00000100:00100000:2.0:1788917136.927792:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140805632:0@lo:400:kworker.0 00000100:00100000:3.0:1788917136.927818:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140805504:0@lo:400:kworker.0 00000100:00100000:1.0:1788917136.927897:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917136.927898:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917136.927898:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917136.927970:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140806016:0@lo:400:kworker.0 00000100:00100000:1.0:1788917136.928003:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140805760 00000100:00100000:0.0:1788917136.928003:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140805888 00000100:00100000:3.0:1788917136.928007:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917136.928014:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140805760 00000100:00100000:0.0:1788917136.928014:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140805888 00000100:00100000:0.0:1788917136.928272:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140806016 00000100:00100000:0.0:1788917136.928277:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140806016 00000100:00100000:1.0:1788917136.928302:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788917136.928314:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788917136.928316:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140805760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917136.928325:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140805888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917136.928345:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917136.928378:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140806144:0@lo:400:kworker.0 00000100:00100000:0.0:1788917136.928396:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140805888:12345-0@lo:400:kworker.0 Request processed in 72us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917136.928404:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788917136.928422:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788917136.928429:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140806016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917136.928442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917136.928457:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140805760:12345-0@lo:400:kworker.0 Request processed in 144us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917136.928466:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788917136.928471:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140806016:12345-0@lo:400:kworker.0 Request processed in 41us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917136.928480:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788917136.928485:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140805632 00000100:00100000:1.0:1788917136.928490:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140805632 00000100:00100000:0.0:1788917136.928495:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140806144 00000100:00100000:0.0:1788917136.928500:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140806144 00000100:00100000:0.0:1788917136.928518:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788917136.928525:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140806144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917136.928562:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140806144:12345-0@lo:400:kworker.0 Request processed in 37us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917136.928569:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788917136.928593:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788917136.928603:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140805632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917136.928623:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140805888:0@lo:400:kworker.0 00000100:00100000:1.0:1788917136.928648:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140805632:12345-0@lo:400:kworker.0 Request processed in 45us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917136.928656:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788917136.928662:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140805632:0@lo:400:kworker.0 00000100:00100000:0.0:1788917136.928688:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140806144:0@lo:400:kworker.0 00000100:00100000:1.0:1788917136.928700:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140805760:0@lo:400:kworker.0 00000100:00080000:0.0:1788917136.928734:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788917136.928740:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788917136.928743:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788917136.928768:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140805504 00000100:00100000:1.0:1788917136.928772:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140805504 00000100:00100000:1.0:1788917136.928802:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788917136.928811:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140805504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917136.928821:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140806016:0@lo:400:kworker.0 00000100:00100000:1.0:1788917136.928864:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140805504:12345-0@lo:400:kworker.0 Request processed in 54us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917136.928873:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788917136.928886:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140805504:0@lo:400:kworker.0 00000100:00100000:1.0:1788917136.931164:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140806272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917136.931252:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917136.931309:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140806272 00000100:00100000:0.0:1788917136.931317:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140806272 00000100:00100000:0.0:1788917136.931362:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788917136.931370:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140806272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788917136.931406:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917136.931470:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140806272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917136.931478:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788917136.931541:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140806272:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788917137.311568:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917137.732625:0:18604:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917137.732637:0:18604:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917137.732685:0:18604:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788917137.732691:0:18604:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917138.335432:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917139.233112:0:18655:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917139.233120:0:18655:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917139.233239:0:18655:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788917139.233245:0:18655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917139.336879:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917139.336924:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917139.336950:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113574272 00000100:00100000:0.0:1788917139.336962:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113574272 00000100:00100000:1.0:1788917139.336971:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917139.336992:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113574528 00000100:00100000:2.0:1788917139.337006:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113574528 00000100:00100000:1.0:1788917139.337057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917139.337102:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:1.0:1788917139.337102:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113574400 00000100:00100000:1.0:1788917139.337111:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113574400 00000100:00100000:2.0:1788917139.337121:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113574528:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917139.337205:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:1.0:1788917139.337207:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:1.0:1788917139.337218:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2373:x1875815113574400:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917139.337223:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113574272:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917139.337298:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113574528:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 179us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917139.337313:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:0.0:1788917139.337322:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113574272:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 94us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917139.337323:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2373:x1875815113574400:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 95us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917139.337338:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:1.0:1788917139.337342:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00080000:0.0:1788917139.337378:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788917139.337386:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917139.337508:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113574144 00000100:00100000:3.0:1788917139.337512:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113574144 00000100:00100000:3.0:1788917139.338683:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00100000:3.0:1788917139.338708:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2373:x1875815113574144:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917139.338766:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2373:x1875815113574144:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 61us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917139.338781:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 142 00010000:00010000:2.0:1788917139.360339:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917139.999954:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140806400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788917140.000049:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917140.000233:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140806400 00000100:00100000:0.0:1788917140.000243:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140806400 00000100:00100000:0.0:1788917140.000325:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788917140.000336:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140806400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788917140.000382:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917140.000440:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140806400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917140.000467:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788917140.000520:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140806400:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788917140.000846:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788917140.383367:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917140.654593:0:18707:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917140.654603:0:18707:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917140.654646:0:18707:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1788917140.654653:0:18707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917141.407436:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917142.048271:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a6a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140806528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788917142.048350:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917142.048811:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140806528 00000100:00100000:0.0:1788917142.048820:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140806528 00000100:00080000:3.0:1788917142.048851:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788917142.048883:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788917142.048894:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140806528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788917142.048929:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917142.048992:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140806528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917142.048999:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788917142.049206:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a6a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140806528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917142.049416:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140806784:0@lo:400:kworker.0 00000100:00100000:1.0:1788917142.049461:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917142.049469:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140806912:0@lo:400:kworker.0 00000100:00100000:1.0:1788917142.049501:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140806784 00000100:00100000:0.0:1788917142.049506:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917142.049507:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140806784 00000100:00100000:0.0:1788917142.049546:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140806912 00000100:00100000:0.0:1788917142.049551:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140806912 00000100:00100000:3.0:1788917142.049560:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140807040:0@lo:400:kworker.0 00000100:00100000:1.0:1788917142.049562:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788917142.049574:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140806784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917142.049584:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788917142.049594:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140806912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917142.049595:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917142.049619:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788917142.049626:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140806656:0@lo:400:kworker.0 00000100:00100000:1.0:1788917142.049632:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140806784:12345-0@lo:400:kworker.0 Request processed in 59us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917142.049644:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788917142.049644:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140806912:12345-0@lo:400:kworker.0 Request processed in 49us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917142.049653:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788917142.049654:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917142.049670:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140807040 00000100:00100000:0.0:1788917142.049673:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140807040 00000100:00100000:3.0:1788917142.049682:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140807168:0@lo:400:kworker.0 00000100:00100000:0.0:1788917142.049695:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788917142.049700:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788917142.049707:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788917142.049708:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917142.049712:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140807040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917142.049735:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140806784:0@lo:400:kworker.0 00000100:00100000:3.0:1788917142.049737:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140807168 00000100:00100000:3.0:1788917142.049742:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140807168 00000100:00100000:0.0:1788917142.049758:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140807040:12345-0@lo:400:kworker.0 Request processed in 48us (162us total) trans 0 rc 0/0 00000100:00080000:1.0:1788917142.049763:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917142.049767:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788917142.049812:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d089180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140806912:0@lo:400:kworker.0 00000100:00100000:2.0:1788917142.050367:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140806656 00000100:00100000:2.0:1788917142.050371:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140806656 00000100:00100000:2.0:1788917142.050394:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788917142.050399:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140806656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917142.050427:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140806656:12345-0@lo:400:kworker.0 Request processed in 28us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917142.050431:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788917142.050466:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d088380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140806656:0@lo:400:kworker.0 00000100:00100000:2.0:1788917142.050478:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d088a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140807040:0@lo:400:kworker.0 00000100:00100000:3.0:1788917142.050547:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788917142.050557:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140807168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917142.050603:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140807168:12345-0@lo:400:kworker.0 Request processed in 48us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917142.050612:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788917142.050624:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140807168:0@lo:400:kworker.0 00000040:00080000:2.0:1788917142.114481:0:18759:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917142.114490:0:18759:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917142.114536:0:18759:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788917142.114542:0:18759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917142.431716:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788917143.458255:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917143.505623:0:18810:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917143.505630:0:18810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917143.505660:0:18810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1788917143.505664:0:18810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917144.455087:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917144.455142:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917144.455208:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917144.455222:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113574784 00000100:00100000:2.0:1788917144.455234:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113574784 00000100:00100000:0.0:1788917144.455286:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113575040 00000100:00100000:0.0:1788917144.455290:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113575040 00000100:00100000:2.0:1788917144.455317:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:2.0:1788917144.455330:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113574784:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917144.455358:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917144.455383:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113574912 00000100:00100000:1.0:1788917144.455386:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113574912 00000100:00100000:1.0:1788917144.455419:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:2.0:1788917144.455421:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113574784:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 89us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917144.455427:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2373:x1875815113574912:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917144.455463:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2373:x1875815113574912:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 37us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917144.455470:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:0.0:1788917144.456139:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00100000:2.0:1788917144.456172:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:0.0:1788917144.456178:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113575040:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917144.456213:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113575040:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 66us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917144.456221:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 84 00000100:00080000:0.0:1788917144.456253:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788917144.456258:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917144.456332:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113574656 00000100:00100000:3.0:1788917144.456337:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113574656 00000100:00100000:3.0:1788917144.456370:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 144 00000100:00100000:3.0:1788917144.456377:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2373:x1875815113574656:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917144.456451:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2373:x1875815113574656:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 74us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917144.456465:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 144 00010000:00010000:2.0:1788917144.479319:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917145.017949:0:18861:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917145.017959:0:18861:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917145.018005:0:18861:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:3.0:1788917145.018010:0:18861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917145.126210:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140807296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788917145.126291:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917145.126367:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140807296 00000100:00100000:3.0:1788917145.126376:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140807296 00000100:00100000:3.0:1788917145.126440:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788917145.126450:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140807296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788917145.126486:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788917145.126534:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140807296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917145.126541:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788917145.126562:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788917145.126599:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140807296:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788917145.183400:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917145.183409:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917145.183690:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 1 00000040:00080000:1.0:1788917145.183695:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917145.504643:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917146.529603:0:18912:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917146.529612:0:18912:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917146.530251:0:18912:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917146.530260:0:18912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917146.530307:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917147.167513:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140807680:0@lo:400:kworker.0 00000100:00100000:0.0:1788917147.167606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917147.167686:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788917147.167693:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140807552:0@lo:400:kworker.0 00000100:00100000:0.0:1788917147.167718:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917147.167739:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140808064:0@lo:400:kworker.0 00000100:00100000:0.0:1788917147.167766:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917147.167813:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140807680 00000100:00100000:0.0:1788917147.167822:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140807680 00000100:00100000:1.0:1788917147.167834:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140807552 00000100:00100000:1.0:1788917147.167849:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140807552 00000100:00100000:0.0:1788917147.167893:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788917147.167916:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140807680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917147.167936:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788917147.167950:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140807552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917147.167981:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140807680:12345-0@lo:400:kworker.0 Request processed in 68us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917147.167992:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788917147.168052:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140807552:12345-0@lo:400:kworker.0 Request processed in 104us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917147.168059:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140807552:0@lo:400:kworker.0 00000100:00100000:1.0:1788917147.168067:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788917147.168092:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140807680:0@lo:400:kworker.0 00000100:00100000:0.0:1788917147.168196:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140807424:0@lo:400:kworker.0 00000100:00080000:1.0:1788917147.168206:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788917147.168216:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788917147.168248:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917147.168310:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140807936:0@lo:400:kworker.0 00000100:00100000:1.0:1788917147.168311:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140807424 00000100:00100000:1.0:1788917147.168320:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140807424 00000100:00100000:0.0:1788917147.168350:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917147.168396:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788917147.168405:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788917147.168407:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140807808:0@lo:400:kworker.0 00000100:00100000:1.0:1788917147.168422:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140807424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917147.168446:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917147.168492:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140807424:0@lo:400:kworker.0 00000100:00100000:0.0:1788917147.168517:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140808064 00000100:00100000:0.0:1788917147.168522:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140808064 00000100:00100000:0.0:1788917147.168568:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140807936 00000100:00100000:0.0:1788917147.168571:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140807936 00000100:00100000:2.0:1788917147.168582:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140807808 00000100:00100000:2.0:1788917147.168589:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140807808 00000100:00100000:0.0:1788917147.168600:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788917147.168610:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140808064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917147.168619:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788917147.168630:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140807936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917147.168732:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140808192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917147.169817:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f268850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140807424:12345-0@lo:400:kworker.0 Request processed in 1395us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917147.169830:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788917147.169856:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140808064:12345-0@lo:400:kworker.0 Request processed in 1245us (2084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917147.169867:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788917147.169901:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788917147.169910:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140807808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917147.169962:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140807808:12345-0@lo:400:kworker.0 Request processed in 54us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917147.170012:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1788917147.170019:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917147.170108:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140807808:0@lo:400:kworker.0 00000100:00100000:2.0:1788917147.170437:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140807936:12345-0@lo:400:kworker.0 Request processed in 1808us (2088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917147.170448:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788917147.171239:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917147.171295:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140808064:0@lo:400:kworker.0 00000100:00100000:1.0:1788917147.172096:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140807936:0@lo:400:kworker.0 00000100:00100000:0.0:1788917147.174044:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140808192 00000100:00100000:0.0:1788917147.174057:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140808192 00000100:00100000:0.0:1788917147.174135:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788917147.174166:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140808192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788917147.174208:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917147.174299:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140808192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (3060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917147.174307:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788917147.174371:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140808192:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788917147.552421:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917147.999412:0:18964:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917147.999423:0:18964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917148.000272:0:18964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917148.000283:0:18964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917148.575430:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917149.581546:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917149.582524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917149.582567:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917149.584322:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113575168 00000100:00100000:1.0:1788917149.584336:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113575168 00000100:00100000:1.0:1788917149.584407:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 146 00000100:00100000:1.0:1788917149.584419:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113575168:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917149.584512:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f268c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113575168:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 94us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917149.584519:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 146 00000100:00100000:1.0:1788917149.584557:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113575424 00000100:00100000:1.0:1788917149.584561:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113575424 00000100:00100000:1.0:1788917149.584601:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:1.0:1788917149.584608:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113575424:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917149.584641:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113575424:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 33us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917149.584647:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00080000:1.0:1788917149.584876:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917149.586284:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917149.596191:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113575296 00000100:00100000:0.0:1788917149.596211:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113575296 00000100:00080000:0.0:1788917149.596256:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917149.596318:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113575552 00000100:00100000:0.0:1788917149.596321:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113575552 00000100:00100000:0.0:1788917149.596356:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:0.0:1788917149.596366:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113575296:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917149.596458:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113575296:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 94us (14927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917149.596466:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:0.0:1788917149.596483:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:0.0:1788917149.596488:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113575552:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917149.596508:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113575552:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 20us (10230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917149.596514:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00080000:0.0:1788917149.596669:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788917149.609824:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917149.611236:0:19016:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917149.611252:0:19016:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917149.611977:0:19016:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917149.611990:0:19016:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788917150.239417:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140808320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788917150.239515:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917150.239567:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140808320 00000100:00100000:0.0:1788917150.239585:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140808320 00000100:00080000:2.0:1788917150.239632:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917150.239659:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788917150.239669:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140808320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788917150.239714:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917150.239772:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140808320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917150.239779:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788917150.241955:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140808320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788917150.625129:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917151.040234:0:19067:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917151.040249:0:19067:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917151.040772:0:19067:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917151.040780:0:19067:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917151.647392:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917152.288598:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140808576:0@lo:400:kworker.0 00000100:00100000:2.0:1788917152.288611:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a6a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140808448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788917152.288690:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917152.288693:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917152.288754:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140808960:0@lo:400:kworker.0 00000100:00100000:2.0:1788917152.288766:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140809088:0@lo:400:kworker.0 00000100:00100000:1.0:1788917152.288799:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917152.288812:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140808832:0@lo:400:kworker.0 00000100:00100000:2.0:1788917152.288844:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917152.288865:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140808960 00000100:00100000:3.0:1788917152.288875:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140808960 00000100:00100000:2.0:1788917152.288878:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140808704:0@lo:400:kworker.0 00000100:00100000:2.0:1788917152.288908:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917152.288919:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140808576 00000100:00100000:1.0:1788917152.288925:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140808576 00000100:00100000:2.0:1788917152.288929:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140809216:0@lo:400:kworker.0 00000100:00100000:3.0:1788917152.288946:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788917152.288956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917152.288962:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140808960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917152.288977:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788917152.288988:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140808576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917152.288991:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140808448 00000100:00100000:2.0:1788917152.288996:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140808448 00000100:00100000:1.0:1788917152.289058:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f269850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140808576:12345-0@lo:400:kworker.0 Request processed in 71us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917152.289063:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788917152.289064:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140808960:12345-0@lo:400:kworker.0 Request processed in 104us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917152.289075:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788917152.289079:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788917152.289079:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140808448:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917152.289100:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140809216 00000100:00100000:3.0:1788917152.289105:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140809216 00002000:00000024:2.0:1788917152.289117:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917152.289169:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140808576:0@lo:400:kworker.0 00000100:00100000:3.0:1788917152.289183:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788917152.289192:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140809216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917152.289251:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140808960:0@lo:400:kworker.0 00000100:00100000:2.0:1788917152.289258:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140808448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 181us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917152.289267:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788917152.289280:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140809216:12345-0@lo:400:kworker.0 Request processed in 87us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917152.289287:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788917152.289297:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140808832 00000100:00100000:2.0:1788917152.289302:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140808832 00000100:00100000:0.0:1788917152.289312:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140809216:0@lo:400:kworker.0 00000100:00100000:2.0:1788917152.289335:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140808704 00000100:00100000:2.0:1788917152.289339:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140808704 00000100:00100000:2.0:1788917152.289370:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788917152.289376:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140808832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917152.289379:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788917152.289388:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140808704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917152.289425:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140808832:12345-0@lo:400:kworker.0 Request processed in 49us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917152.289426:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140808704:12345-0@lo:400:kworker.0 Request processed in 41us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917152.289434:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788917152.289439:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788917152.289453:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140808832:0@lo:400:kworker.0 00000100:00080000:2.0:1788917152.289462:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917152.289467:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140808704:0@lo:400:kworker.0 00000100:00080000:2.0:1788917152.289468:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788917152.289471:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788917152.289754:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917152.289791:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a6a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140808448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917152.289841:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140809088 00000100:00100000:1.0:1788917152.289846:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140809088 00000100:00080000:2.0:1788917152.289947:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917152.289954:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788917152.289964:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140809088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917152.290015:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140809088:12345-0@lo:400:kworker.0 Request processed in 52us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917152.290022:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788917152.290056:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140809088:0@lo:400:kworker.0 00000040:00080000:3.0:1788917152.416588:0:19118:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917152.416601:0:19118:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917152.417198:0:19118:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917152.417208:0:19118:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917152.671713:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917153.695364:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917153.812880:0:19170:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917153.812888:0:19170:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917153.813311:0:19170:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917153.813319:0:19170:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788917154.696069:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917154.696131:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917154.696228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917154.696260:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917154.696403:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113575808 00000100:00100000:1.0:1788917154.696415:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113575808 00000100:00100000:1.0:1788917154.696491:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113576064 00000100:00100000:1.0:1788917154.696494:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113576064 00000100:00100000:1.0:1788917154.696517:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 93 00000100:00100000:1.0:1788917154.696526:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2372:x1875815113575808:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917154.696612:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2372:x1875815113575808:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 87us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917154.696618:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 93 00000100:00100000:1.0:1788917154.696637:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 94 00000100:00100000:1.0:1788917154.696642:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:2372:x1875815113576064:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917154.696665:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:2372:x1875815113576064:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917154.696671:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 94 00000100:00100000:1.0:1788917154.696688:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113575936 00000100:00100000:1.0:1788917154.696691:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113575936 00000100:00100000:1.0:1788917154.696718:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:1.0:1788917154.696723:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2371:x1875815113575936:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917154.696748:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2371:x1875815113575936:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917154.696754:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00080000:0.0:1788917154.696828:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788917154.696832:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917154.697087:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113575680 00000100:00100000:2.0:1788917154.697091:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113575680 00000100:00100000:2.0:1788917154.697130:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 148 00000100:00100000:2.0:1788917154.697138:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2371:x1875815113575680:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917154.697272:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2371:x1875815113575680:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 134us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917154.697279:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 148 00010000:00010000:2.0:1788917154.719388:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917155.341285:0:19222:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917155.341300:0:19222:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917155.341966:0:19222:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917155.341976:0:19222:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788917155.360314:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140809344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788917155.360400:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917155.360455:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140809344 00000100:00100000:0.0:1788917155.360470:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140809344 00000100:00100000:0.0:1788917155.360539:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788917155.360552:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140809344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788917155.360599:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917155.360658:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140809344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917155.360666:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788917155.362083:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917155.362161:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140809344:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788917155.424569:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917155.424580:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917155.425107:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917155.425119:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917155.743388:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917156.724954:0:19273:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917156.724966:0:19273:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917156.725446:0:19273:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917156.725455:0:19273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917156.767303:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917157.407541:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140809728:0@lo:400:kworker.0 00000100:00100000:3.0:1788917157.407588:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140809600:0@lo:400:kworker.0 00000100:00100000:2.0:1788917157.407598:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140809472:0@lo:400:kworker.0 00000100:00100000:0.0:1788917157.407631:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917157.407647:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140809856:0@lo:400:kworker.0 00000100:00100000:2.0:1788917157.407660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917157.407741:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140809472 00000100:00100000:1.0:1788917157.407750:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140809472 00000100:00100000:1.0:1788917157.407801:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788917157.407811:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140809472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917157.407883:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3fcb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140810240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788917157.408634:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140809984:0@lo:400:kworker.0 00000100:00100000:2.0:1788917157.408665:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917157.408712:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140809472:12345-0@lo:400:kworker.0 Request processed in 901us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917157.408716:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140809472:0@lo:400:kworker.0 00000100:00100000:1.0:1788917157.408724:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788917157.408753:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140809728 00000100:00100000:2.0:1788917157.408758:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140809728 00000100:00100000:1.0:1788917157.408773:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140809984 00000100:00100000:1.0:1788917157.408778:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140809984 00000100:00100000:2.0:1788917157.408808:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788917157.408818:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788917157.408820:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140809728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917157.408855:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140809728:12345-0@lo:400:kworker.0 Request processed in 40us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917157.408859:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788917157.408872:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788917157.408886:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788917157.408900:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917157.408915:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140810112:0@lo:400:kworker.0 00000100:00100000:1.0:1788917157.408921:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140809984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917157.408939:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917157.408976:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140809600 00000100:00100000:2.0:1788917157.408980:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140809600 00000100:00100000:2.0:1788917157.409021:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788917157.409028:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140809600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917157.409044:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140809984:12345-0@lo:400:kworker.0 Request processed in 216us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917157.409053:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788917157.409068:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140810112 00000100:00100000:1.0:1788917157.409072:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140810112 00000100:00100000:2.0:1788917157.409074:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140809600:12345-0@lo:400:kworker.0 Request processed in 46us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917157.409083:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788917157.409100:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917157.409104:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1788917157.409106:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917157.409114:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140810112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917157.409130:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140809600:0@lo:400:kworker.0 00000100:00100000:1.0:1788917157.409174:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140810112:12345-0@lo:400:kworker.0 Request processed in 61us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917157.409181:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140810112:0@lo:400:kworker.0 00000100:00100000:1.0:1788917157.409183:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788917157.409278:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140809984:0@lo:400:kworker.0 00000100:00100000:3.0:1788917157.409370:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917157.409380:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917157.409422:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140809728:0@lo:400:kworker.0 00000100:00100000:0.0:1788917157.409450:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140810240 00000100:00100000:0.0:1788917157.409455:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140810240 00000100:00100000:0.0:1788917157.409507:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788917157.409517:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140810240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788917157.409545:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917157.409650:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140809856 00000100:00100000:1.0:1788917157.409654:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140809856 00000100:00100000:1.0:1788917157.409680:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788917157.409687:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140809856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917157.409740:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140809856:12345-0@lo:400:kworker.0 Request processed in 53us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917157.409751:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788917157.409755:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140809856:0@lo:400:kworker.0 00000100:00100000:0.0:1788917157.409789:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140810240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 273us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917157.409798:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3fcb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140810240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917157.409798:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1788917157.791681:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917158.207886:0:19324:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917158.207894:0:19324:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917158.208611:0:19324:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917158.208624:0:19324:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917158.815502:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917159.672710:0:19376:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917159.672718:0:19376:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917159.673321:0:19376:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917159.673332:0:19376:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788917159.815113:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917159.815202:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113576192 00000100:00100000:1.0:1788917159.815214:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113576192 00000100:00100000:1.0:1788917159.815344:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 150 00000100:00100000:1.0:1788917159.815356:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113576192:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917159.815452:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f269050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113576192:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 99us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917159.815461:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 150 00000100:00100000:3.0:1788917159.817520:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917159.817551:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917159.817577:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917159.817607:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113576448 00000100:00100000:2.0:1788917159.817616:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113576448 00000100:00100000:2.0:1788917159.817678:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00080000:3.0:1788917159.817679:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917159.817690:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2373:x1875815113576448:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917159.817748:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2373:x1875815113576448:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 60us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917159.817755:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:1.0:1788917159.817759:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113576320 00000100:00100000:0.0:1788917159.817760:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113576576 00000100:00100000:1.0:1788917159.817765:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113576320 00000100:00100000:0.0:1788917159.817766:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113576576 00000100:00080000:2.0:1788917159.817814:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917159.817824:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 98 00000100:00100000:0.0:1788917159.817834:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 99 00000100:00100000:1.0:1788917159.817836:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113576320:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917159.817849:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113576576:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917159.817875:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113576320:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 42us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917159.817884:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 98 00000100:00100000:0.0:1788917159.817889:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113576576:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 43us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917159.817909:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 99 00010000:00010000:1.0:1788917159.842102:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917160.481010:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788917160.481048:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140810368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917160.481142:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917160.481232:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140810368 00000100:00100000:2.0:1788917160.481248:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140810368 00000100:00080000:0.0:1788917160.482573:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917160.482608:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788917160.482626:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140810368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788917160.482668:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917160.483121:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140810368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 500us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917160.483131:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788917160.483135:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140810368:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788917160.863567:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917161.085972:0:19427:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917161.085979:0:19427:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917161.086390:0:19427:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917161.086398:0:19427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917161.887495:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917162.511092:0:19479:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917162.511102:0:19479:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917162.511706:0:19479:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917162.511715:0:19479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917162.527432:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140810496:0@lo:400:kworker.0 00000100:00100000:1.0:1788917162.527499:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917162.527621:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140810496 00000100:00100000:2.0:1788917162.527630:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140810496 00000100:00100000:2.0:1788917162.527684:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788917162.527693:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140810496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917162.528212:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140810624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917162.528239:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917162.528389:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f268450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140810496:12345-0@lo:400:kworker.0 Request processed in 696us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917162.528396:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788917162.528446:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140810624 00000100:00100000:2.0:1788917162.528450:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140810624 00000100:00100000:3.0:1788917162.528583:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140810880:0@lo:400:kworker.0 00000100:00100000:3.0:1788917162.528606:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917162.528627:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788917162.528631:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140811008:0@lo:400:kworker.0 00000100:00100000:3.0:1788917162.528646:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917162.529097:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140810752:0@lo:400:kworker.0 00000100:00100000:2.0:1788917162.529129:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917162.529166:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788917162.529173:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140811136:0@lo:400:kworker.0 00000100:00100000:2.0:1788917162.529196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917162.529224:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140810752 00000100:00100000:2.0:1788917162.529229:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140810752 00000100:00100000:1.0:1788917162.529285:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140810496:0@lo:400:kworker.0 00000100:00100000:1.0:1788917162.529306:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140810880 00000100:00100000:1.0:1788917162.529308:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140810880 00000100:00100000:1.0:1788917162.529331:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140811008 00000100:00100000:1.0:1788917162.529333:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140811008 00000100:00100000:3.0:1788917162.529514:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788917162.529522:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140810624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788917162.529555:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788917162.529594:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140810624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917162.529600:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788917162.529624:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140810624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917162.529641:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140811136 00000100:00100000:3.0:1788917162.529643:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140811136 00000100:00080000:0.0:1788917162.529691:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788917162.529695:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788917162.529696:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788917162.530017:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788917162.530025:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140810752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917162.530065:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140810752:12345-0@lo:400:kworker.0 Request processed in 42us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917162.530071:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788917162.530106:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140810752:0@lo:400:kworker.0 00000100:00100000:2.0:1788917162.530285:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788917162.530293:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140810880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917162.530337:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140810880:12345-0@lo:400:kworker.0 Request processed in 44us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917162.530343:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788917162.530373:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140810880:0@lo:400:kworker.0 00000100:00100000:1.0:1788917162.530965:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788917162.530974:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140811008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917162.531017:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140811008:12345-0@lo:400:kworker.0 Request processed in 45us (2368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917162.531023:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788917162.531052:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140811008:0@lo:400:kworker.0 00000100:00100000:3.0:1788917162.532027:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788917162.532037:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140811136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917162.532093:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140811136:12345-0@lo:400:kworker.0 Request processed in 59us (2895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917162.532099:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788917162.532132:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140811136:0@lo:400:kworker.0 00010000:00010000:1.0:1788917162.911330:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917163.935681:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917163.945723:0:19530:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917163.945736:0:19530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917163.946330:0:19530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917163.946339:0:19530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917164.934799:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917164.934854:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917164.934883:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113576704 00000100:00100000:1.0:1788917164.934895:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113576704 00000100:00100000:3.0:1788917164.934901:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917164.934945:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113576832 00000100:00100000:2.0:1788917164.934951:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113576832 00000100:00100000:3.0:1788917164.934956:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917164.934961:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113577088 00000100:00100000:0.0:1788917164.934968:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113577088 00000100:00100000:1.0:1788917164.934977:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 152 00000100:00100000:1.0:1788917164.934989:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113576704:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917164.935020:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 103 00000100:00080000:3.0:1788917164.935022:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917164.935030:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 104 00000100:00100000:2.0:1788917164.935035:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113576832:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917164.935038:0:14266:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788917164.935047:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113577088:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917164.935052:0:14266:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788917164.935061:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113576704:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 75us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917164.935068:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 152 00000100:00100000:2.0:1788917164.935089:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113576832:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 58us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917164.935102:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 103 00000100:00100000:0.0:1788917164.935105:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113577088:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 55us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917164.935106:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113576960 00000100:00100000:1.0:1788917164.935110:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113576960 00000100:00100000:0.0:1788917164.935120:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 104 00000100:00100000:1.0:1788917164.935181:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:1.0:1788917164.935205:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113576960:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917164.935232:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113576960:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 29us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917164.935237:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00080000:3.0:1788917164.935250:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788917164.959388:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917165.312287:0:19582:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917165.312297:0:19582:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917165.312884:0:19582:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917165.312893:0:19582:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917165.599424:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140811264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788917165.599533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917165.599643:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140811264 00000100:00100000:0.0:1788917165.599663:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140811264 00000100:00100000:0.0:1788917165.599756:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788917165.599760:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917165.599769:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140811264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788917165.599817:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917165.599952:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140811264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917165.599961:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788917165.599999:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140811264:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788917165.663391:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917165.663400:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917165.663820:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917165.663827:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917165.983432:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917166.792785:0:19633:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917166.792798:0:19633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917166.796526:0:19633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917166.796557:0:19633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917167.007490:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917167.647418:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788917167.647516:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140811520:0@lo:400:kworker.0 00000100:00100000:3.0:1788917167.647586:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140811776:0@lo:400:kworker.0 00000100:00100000:1.0:1788917167.647613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917167.647647:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140811904:0@lo:400:kworker.0 00000100:00100000:3.0:1788917167.647723:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917167.647760:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140811392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917167.647761:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788917167.647771:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140811648:0@lo:400:kworker.0 00000100:00100000:1.0:1788917167.647800:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917167.647810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917167.647832:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140812032:0@lo:400:kworker.0 00000100:00100000:3.0:1788917167.647842:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140812160:0@lo:400:kworker.0 00000100:00100000:3.0:1788917167.647920:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140811520 00000100:00100000:3.0:1788917167.647929:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140811520 00000100:00100000:1.0:1788917167.647929:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917167.647986:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788917167.647990:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140811392 00000100:00100000:1.0:1788917167.647996:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140811392 00000100:00100000:3.0:1788917167.647998:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140811520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917167.648048:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788917167.648058:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140811392:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917167.648074:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f268050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140811520:12345-0@lo:400:kworker.0 Request processed in 78us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917167.648083:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00002000:00000024:1.0:1788917167.648091:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917167.648135:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140811392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917167.648172:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788917167.648196:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788917167.648220:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917167.648224:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140811776 00000100:00100000:3.0:1788917167.648229:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140811776 00000100:00100000:1.0:1788917167.648257:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140812032 00000100:00100000:3.0:1788917167.648260:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140811648 00000100:00100000:1.0:1788917167.648263:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140812032 00000100:00100000:3.0:1788917167.648266:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140811648 00000100:00100000:3.0:1788917167.648304:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788917167.648311:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140812160 00000100:00100000:3.0:1788917167.648312:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140811776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917167.648316:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140812160 00000100:00100000:3.0:1788917167.648356:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f624700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140811776:12345-0@lo:400:kworker.0 Request processed in 45us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917167.648364:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788917167.648369:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788917167.648379:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140812032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917167.648381:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788917167.648393:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140811648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917167.648426:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140812032:12345-0@lo:400:kworker.0 Request processed in 47us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917167.648434:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140811648:12345-0@lo:400:kworker.0 Request processed in 44us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917167.648447:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788917167.648452:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788917167.648467:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788917167.648476:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140812160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917167.648510:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140812160:12345-0@lo:400:kworker.0 Request processed in 36us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917167.648517:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1788917167.648536:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788917167.648540:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140812032:0@lo:400:kworker.0 00000100:00080000:1.0:1788917167.648541:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917167.648555:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140811520:0@lo:400:kworker.0 00000100:00100000:1.0:1788917167.648567:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140811648:0@lo:400:kworker.0 00000100:00100000:3.0:1788917167.648577:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140811392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917167.648586:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140812160:0@lo:400:kworker.0 00000100:00100000:1.0:1788917167.648603:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140811776:0@lo:400:kworker.0 00000100:00100000:0.0:1788917167.648847:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917167.649321:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140811904 00000100:00100000:1.0:1788917167.649326:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140811904 00000100:00100000:1.0:1788917167.649361:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788917167.649368:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140811904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917167.649423:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140811904:12345-0@lo:400:kworker.0 Request processed in 55us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917167.649430:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788917167.649534:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140811904:0@lo:400:kworker.0 00010000:00010000:3.0:1788917168.031778:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917168.294849:0:19684:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917168.294864:0:19684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917168.295500:0:19684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917168.295517:0:19684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917169.055400:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917169.777760:0:19736:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917169.777771:0:19736:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917169.778365:0:19736:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917169.778377:0:19736:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917170.058463:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917170.058522:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917170.058561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917170.058589:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917170.058619:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113577344 00000100:00100000:0.0:1788917170.058620:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113577600 00000100:00100000:3.0:1788917170.058627:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113577344 00000100:00100000:0.0:1788917170.058628:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113577600 00000100:00100000:3.0:1788917170.058681:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 108 00000100:00100000:3.0:1788917170.058690:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113577344:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917170.058711:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 109 00000100:00100000:0.0:1788917170.058721:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113577600:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917170.058755:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f626d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113577344:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 67us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917170.058763:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113577600:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 42us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917170.058768:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 108 00000100:00100000:0.0:1788917170.058777:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 109 00000100:00100000:1.0:1788917170.058949:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113577216 00000100:00100000:1.0:1788917170.058954:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113577216 00000100:00100000:1.0:1788917170.058990:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 154 00000100:00100000:1.0:1788917170.059011:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113577216:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917170.059044:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113577216:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 34us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917170.059050:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 154 00000100:00080000:1.0:1788917170.059081:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917170.059199:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113577472 00000100:00100000:2.0:1788917170.059210:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113577472 00000100:00100000:2.0:1788917170.059251:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:2.0:1788917170.059259:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113577472:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917170.059287:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f625c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113577472:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 30us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917170.059294:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00080000:1.0:1788917170.059465:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788917170.079330:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917170.719455:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140812288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917170.719549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917170.719594:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140812288 00000100:00100000:2.0:1788917170.719603:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140812288 00000100:00080000:3.0:1788917170.719678:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917170.719708:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788917170.719720:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140812288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788917170.719774:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917170.719835:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140812288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917170.719843:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788917170.719903:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140812288:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788917171.103396:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917171.204078:0:19787:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917171.204086:0:19787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917171.205036:0:19787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917171.205049:0:19787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917172.127347:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917172.605660:0:19838:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917172.605672:0:19838:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917172.607439:0:19838:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917172.607457:0:19838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788917172.767389:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140812416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917172.767501:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917172.767530:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140812800:0@lo:400:kworker.0 00000100:00100000:1.0:1788917172.767569:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917172.767586:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140812928:0@lo:400:kworker.0 00000100:00100000:1.0:1788917172.767593:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788917172.767601:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140812672:0@lo:400:kworker.0 00000100:00100000:0.0:1788917172.767627:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917172.767634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917172.767657:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140813184:0@lo:400:kworker.0 00000100:00100000:0.0:1788917172.767658:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788917172.767665:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140812544:0@lo:400:kworker.0 00000100:00100000:3.0:1788917172.767741:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140812800 00000100:00100000:3.0:1788917172.767750:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140812800 00000100:00100000:1.0:1788917172.767791:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917172.767819:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140812672 00000100:00100000:2.0:1788917172.767825:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140812672 00000100:00100000:3.0:1788917172.767868:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788917172.767877:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788917172.767884:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140812800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917172.767892:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140812672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917172.767942:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140812800:12345-0@lo:400:kworker.0 Request processed in 65us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917172.767948:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788917172.767964:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d088380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140812672:12345-0@lo:400:kworker.0 Request processed in 78us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917172.767972:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1788917172.767990:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788917172.767995:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788917172.768290:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140812416 00000100:00100000:3.0:1788917172.768294:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140812416 00000100:00100000:3.0:1788917172.768316:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788917172.768321:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140812416:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917172.768329:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788917172.768347:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917172.768376:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140813056:0@lo:400:kworker.0 00000100:00100000:3.0:1788917172.768383:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140812416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917172.768391:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788917172.768418:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140812544 00000100:00100000:0.0:1788917172.768423:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140812544 00000100:00100000:0.0:1788917172.768473:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788917172.768481:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140812544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917172.768520:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140812544:12345-0@lo:400:kworker.0 Request processed in 40us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917172.768537:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788917172.768769:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917172.768832:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140812800:0@lo:400:kworker.0 00000100:00100000:1.0:1788917172.768883:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140812672:0@lo:400:kworker.0 00000100:00100000:2.0:1788917172.769350:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140812928 00000100:00100000:2.0:1788917172.769357:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140812928 00000100:00100000:0.0:1788917172.769383:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d08d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140812416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788917172.769405:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140813184 00000100:00100000:0.0:1788917172.769405:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140812544:0@lo:400:kworker.0 00000100:00100000:2.0:1788917172.769411:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140813184 00000100:00100000:2.0:1788917172.769459:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140813056 00000100:00100000:2.0:1788917172.769462:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140813056 00000100:00100000:1.0:1788917172.769481:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788917172.769494:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140812928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917172.769497:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788917172.769508:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140813184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917172.769560:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140812928:12345-0@lo:400:kworker.0 Request processed in 69us (1932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917172.769561:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140813184:12345-0@lo:400:kworker.0 Request processed in 55us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917172.769572:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788917172.769578:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788917172.769589:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788917172.769598:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140812928:0@lo:400:kworker.0 00000100:00100000:2.0:1788917172.769600:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140813056:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788917172.769622:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917172.769651:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140813056:12345-0@lo:400:kworker.0 Request processed in 55us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917172.769657:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788917172.769662:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140813184:0@lo:400:kworker.0 00000100:00100000:0.0:1788917172.769672:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140813056:0@lo:400:kworker.0 00010000:00010000:2.0:1788917173.151829:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917174.042923:0:19889:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917174.042933:0:19889:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917174.043562:0:19889:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917174.043571:0:19889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788917174.175272:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917175.175048:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917175.175094:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917175.175126:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917175.175182:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917175.175211:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113577984 00000100:00100000:3.0:1788917175.175221:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113577984 00000100:00100000:3.0:1788917175.175282:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:3.0:1788917175.175293:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113577984:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917175.175300:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113577728 00000100:00100000:2.0:1788917175.175307:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113577728 00000100:00100000:2.0:1788917175.175347:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 156 00000100:00100000:2.0:1788917175.175357:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113577728:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917175.175372:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113577984:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 80us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917175.175381:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:2.0:1788917175.175394:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f26b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113577728:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 37us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917175.175403:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 156 00000100:00100000:1.0:1788917175.176939:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113577856 00000100:00100000:1.0:1788917175.176949:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113577856 00000100:00100000:1.0:1788917175.176994:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113578112 00000100:00100000:1.0:1788917175.176997:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113578112 00000100:00100000:1.0:1788917175.177029:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 113 00000100:00100000:1.0:1788917175.177038:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113577856:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917175.177097:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 114 00000100:00100000:1.0:1788917175.177103:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113577856:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 64us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917175.177110:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113578112:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917175.177117:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 113 00000100:00080000:1.0:1788917175.177166:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917175.177167:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113578112:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 33us (2012us total) trans 0 rc 0/0 00000100:00080000:1.0:1788917175.177172:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917175.177178:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 114 00010000:00010000:1.0:1788917175.199536:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917175.473345:0:19940:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917175.473354:0:19940:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917175.474215:0:19940:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917175.474227:0:19940:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917175.839364:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140813312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917175.839444:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917175.839511:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140813312 00000100:00100000:3.0:1788917175.839522:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140813312 00000100:00080000:1.0:1788917175.839586:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788917175.839607:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788917175.839617:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140813312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788917175.839655:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788917175.839716:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d08a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140813312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917175.839723:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788917175.839975:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140813312:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788917175.903502:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917175.903516:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917175.904174:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917175.904186:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917176.223343:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917176.887665:0:19992:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917176.887681:0:19992:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917176.890046:0:19992:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917176.890059:0:19992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788917177.247444:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917177.887315:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788917177.887341:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140813440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917177.887423:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917177.887496:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140813440 00000100:00100000:0.0:1788917177.887505:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140813440 00000100:00080000:1.0:1788917177.887561:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788917177.887576:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788917177.887587:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140813440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788917177.887623:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917177.887683:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140813440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917177.887690:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788917177.887858:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140813440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917177.888073:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a6a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140813568:0@lo:400:kworker.0 00000100:00100000:2.0:1788917177.888105:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140813824:0@lo:400:kworker.0 00000100:00100000:1.0:1788917177.888115:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917177.888115:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140813696:0@lo:400:kworker.0 00000100:00100000:1.0:1788917177.888171:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140814080:0@lo:400:kworker.0 00000100:00100000:0.0:1788917177.888191:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917177.888198:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917177.888218:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140813568 00000100:00100000:1.0:1788917177.888222:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140813568 00000100:00100000:0.0:1788917177.888232:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140813952:0@lo:400:kworker.0 00000100:00100000:1.0:1788917177.888263:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788917177.888265:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917177.888275:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140813568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917177.888292:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140813824 00000100:00100000:2.0:1788917177.888297:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140813824 00000100:00100000:0.0:1788917177.888314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917177.888321:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140813568:12345-0@lo:400:kworker.0 Request processed in 47us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917177.888328:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788917177.888345:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a6a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140813568:0@lo:400:kworker.0 00000100:00100000:3.0:1788917177.888363:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140813696 00000100:00100000:3.0:1788917177.888368:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140813696 00000100:00100000:3.0:1788917177.888405:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788917177.888413:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140813696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917177.888453:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140813696:12345-0@lo:400:kworker.0 Request processed in 41us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917177.888459:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788917177.888500:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140813696:0@lo:400:kworker.0 00000100:00080000:3.0:1788917177.888520:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917177.889935:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140813952 00000100:00100000:0.0:1788917177.889944:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140814080 00000100:00100000:1.0:1788917177.889947:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140813952 00000100:00100000:0.0:1788917177.889951:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140814080 00000100:00100000:0.0:1788917177.890008:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788917177.890104:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140813824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917177.890120:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788917177.890129:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140814080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917177.890221:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140814080:12345-0@lo:400:kworker.0 Request processed in 92us (1907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917177.890229:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140813824:12345-0@lo:400:kworker.0 Request processed in 212us (2033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917177.890230:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788917177.890240:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788917177.890252:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788917177.890273:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140813952:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788917177.890279:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917177.890315:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140813952:12345-0@lo:400:kworker.0 Request processed in 44us (2052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917177.890321:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140814080:0@lo:400:kworker.0 00000100:00100000:1.0:1788917177.890325:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788917177.890329:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140813824:0@lo:400:kworker.0 00000100:00100000:1.0:1788917177.890357:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140813952:0@lo:400:kworker.0 00010000:00010000:1.0:1788917178.271474:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917178.394038:0:20043:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917178.394046:0:20043:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917178.394747:0:20043:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917178.394756:0:20043:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917179.295390:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917179.899034:0:20094:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917179.899043:0:20094:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917179.899560:0:20094:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917179.899571:0:20094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917180.295206:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917180.295247:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917180.295270:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113578240 00000100:00100000:2.0:1788917180.295290:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113578240 00000100:00100000:3.0:1788917180.295343:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917180.295451:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 158 00000100:00100000:3.0:1788917180.295452:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917180.295467:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113578240:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917180.295492:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113578496 00000100:00100000:3.0:1788917180.295497:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113578496 00000100:00100000:3.0:1788917180.295543:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:3.0:1788917180.295551:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113578496:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917180.295657:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113578496:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 105us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917180.295665:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00080000:3.0:1788917180.295686:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917180.295703:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37124c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113578240:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 239us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917180.295711:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 158 00000100:00100000:0.0:1788917180.296006:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113578368 00000100:00100000:1.0:1788917180.296008:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113578624 00000100:00100000:0.0:1788917180.296012:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113578368 00000100:00100000:1.0:1788917180.296015:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113578624 00000100:00080000:3.0:1788917180.296088:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917180.296463:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:1.0:1788917180.296473:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113578624:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917180.296480:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 119 00000100:00100000:0.0:1788917180.296491:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113578368:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917180.296521:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113578624:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 49us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917180.296531:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113578368:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 41us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917180.296532:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:0.0:1788917180.296543:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 119 00010000:00010000:3.0:1788917180.319345:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917180.959324:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140814208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788917180.959406:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917180.959464:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140814208 00000100:00100000:1.0:1788917180.959473:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140814208 00000100:00080000:3.0:1788917180.959509:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917180.959556:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788917180.959567:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140814208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788917180.959607:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917180.959664:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140814208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917180.959671:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788917180.959705:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140814208:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788917181.272320:0:20145:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917181.272330:0:20145:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917181.272829:0:20145:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917181.272838:0:20145:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917181.343381:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788917182.367520:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917182.634644:0:20196:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917182.634657:0:20196:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917182.635399:0:20196:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917182.635410:0:20196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917183.007973:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140814464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788917183.008041:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3305:1875815140814336:0@lo:400:kworker.0 00000100:00100000:0.0:1788917183.008055:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140814592:0@lo:400:kworker.0 00000100:00100000:2.0:1788917183.008166:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917183.008169:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917183.008236:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140814848:0@lo:400:kworker.0 00000100:00100000:2.0:1788917183.008292:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917183.008318:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788917183.008326:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140814720:0@lo:400:kworker.0 00000100:00100000:2.0:1788917183.008354:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917183.008375:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140815104:0@lo:400:kworker.0 00000100:00100000:2.0:1788917183.008387:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140814336 00000100:00100000:2.0:1788917183.008394:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140814336 00000100:00100000:0.0:1788917183.008412:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917183.008440:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788917183.008449:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140814976:0@lo:400:kworker.0 00000100:00100000:2.0:1788917183.008454:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788917183.008465:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3305:x1875815140814336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917183.008497:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140814848 00000100:00100000:1.0:1788917183.008504:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140814848 00000100:00100000:2.0:1788917183.008514:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37126050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3305:x1875815140814336:12345-0@lo:400:kworker.0 Request processed in 52us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917183.008520:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788917183.008548:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140815104 00000100:00100000:1.0:1788917183.008553:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140815104 00000100:00100000:0.0:1788917183.008554:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917183.008558:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788917183.008566:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140814848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917183.008591:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140814976 00000100:00100000:1.0:1788917183.008596:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140814976 00000100:00100000:2.0:1788917183.008598:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140814848:12345-0@lo:400:kworker.0 Request processed in 34us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917183.008603:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788917183.008611:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788917183.008617:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140815104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917183.008630:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788917183.008636:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140814976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917183.008675:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140815104:12345-0@lo:400:kworker.0 Request processed in 61us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917183.008677:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140814976:12345-0@lo:400:kworker.0 Request processed in 40us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917183.008689:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788917183.008695:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140814976:0@lo:400:kworker.0 00000100:00100000:1.0:1788917183.008710:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140815104:0@lo:400:kworker.0 00000100:00100000:2.0:1788917183.008717:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788917183.008770:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140814848:0@lo:400:kworker.0 00000100:00100000:2.0:1788917183.008779:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3305:1875815140814336:0@lo:400:kworker.0 00000100:00100000:1.0:1788917183.008785:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140814592 00000100:00100000:1.0:1788917183.008790:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140814592 00000100:00080000:2.0:1788917183.008812:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788917183.008819:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917183.008822:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140814720 00000100:00100000:1.0:1788917183.008826:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140814720 00000100:00100000:1.0:1788917183.008863:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788917183.008870:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788917183.008874:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3b8cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140814592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917183.008884:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140814720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917183.008934:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140814720:12345-0@lo:400:kworker.0 Request processed in 54us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917183.008943:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788917183.008952:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3b8cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140814592:12345-0@lo:400:kworker.0 Request processed in 80us (809us total) trans 0 rc 0/0 00000100:00080000:2.0:1788917183.008962:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788917183.008962:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788917183.008985:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140814720:0@lo:400:kworker.0 00000100:00100000:0.0:1788917183.008997:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140814592:0@lo:400:kworker.0 00000100:00100000:3.0:1788917183.010763:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917183.011027:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140814464 00000100:00100000:2.0:1788917183.011034:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140814464 00000100:00100000:2.0:1788917183.011072:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788917183.011082:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140814464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788917183.011117:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917183.011189:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140814464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917183.011197:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788917183.011283:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140814464:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788917183.394819:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917184.046420:0:20248:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917184.046431:0:20248:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917184.047012:0:20248:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917184.047021:0:20248:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917184.415384:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917185.121107:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917185.121115:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917185.121648:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917185.121657:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917185.414849:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917185.414995:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917185.415028:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917185.415063:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113578752 00000100:00100000:0.0:1788917185.415076:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113578752 00000100:00100000:3.0:1788917185.415119:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917185.415137:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 160 00000100:00100000:0.0:1788917185.415178:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113578752:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917185.415185:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113579008 00000100:00100000:3.0:1788917185.415191:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113579008 00000100:00100000:3.0:1788917185.415242:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:3.0:1788917185.415251:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113579008:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917185.415297:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113579008:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 43us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917185.415297:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113578752:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 146us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917185.415310:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 75 00000100:00100000:0.0:1788917185.415314:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 160 00000100:00080000:3.0:1788917185.415338:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917185.415530:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113578880 00000100:00100000:1.0:1788917185.415534:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113578880 00000100:00080000:3.0:1788917185.415580:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917185.415581:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113579136 00000100:00100000:1.0:1788917185.415584:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113579136 00000100:00100000:3.0:1788917185.415607:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00100000:3.0:1788917185.415617:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113578880:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917185.415627:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:1.0:1788917185.415635:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113579136:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917185.415701:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113578880:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 85us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917185.415701:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113579136:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 65us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917185.415709:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:3.0:1788917185.415714:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00080000:3.0:1788917185.415784:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788917185.439331:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917185.481406:0:20299:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917185.481420:0:20299:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917185.481919:0:20299:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917185.481929:0:20299:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788917186.079424:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788917186.079458:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140815232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788917186.079536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917186.079703:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140815232 00000100:00100000:1.0:1788917186.079712:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140815232 00000100:00080000:3.0:1788917186.079786:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917186.079807:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788917186.079817:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140815232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788917186.079854:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917186.079911:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140815232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917186.079925:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788917186.079972:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140815232:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788917186.463414:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917186.914388:0:20350:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917186.914396:0:20350:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917186.914927:0:20350:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917186.914933:0:20350:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788917187.487425:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917188.128350:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788917188.128378:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140815360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917188.128468:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917188.128922:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140815360 00000100:00100000:2.0:1788917188.128932:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140815360 00000100:00100000:2.0:1788917188.129041:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788917188.129061:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140815360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788917188.129108:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917188.129223:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140815360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917188.129236:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788917188.129365:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788917188.129434:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140815360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917188.133963:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a6a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140815488:0@lo:400:kworker.0 00000100:00100000:2.0:1788917188.134004:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a6a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140815616:0@lo:400:kworker.0 00000100:00100000:3.0:1788917188.134101:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917188.134134:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917188.134211:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140816000:0@lo:400:kworker.0 00000100:00100000:2.0:1788917188.134225:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140815616 00000100:00100000:2.0:1788917188.134235:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140815616 00000100:00100000:3.0:1788917188.134254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917188.134296:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140815488 00000100:00100000:3.0:1788917188.134301:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140815488 00000100:00100000:2.0:1788917188.134319:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788917188.134331:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140815616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917188.134357:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788917188.134368:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140815488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917188.134400:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140815616:12345-0@lo:400:kworker.0 Request processed in 71us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917188.134410:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788917188.134445:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37127850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140815488:12345-0@lo:400:kworker.0 Request processed in 70us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917188.134448:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875815140815872:0@lo:400:kworker.0 00000100:00100000:3.0:1788917188.134457:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788917188.134485:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917188.134504:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140816000 00000100:00100000:2.0:1788917188.134513:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788917188.134519:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140816000 00000100:00100000:2.0:1788917188.134521:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a6a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140815744:0@lo:400:kworker.0 00000100:00100000:2.0:1788917188.134552:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917188.134565:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140815872 00000100:00100000:3.0:1788917188.134570:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140815872 00000100:00100000:2.0:1788917188.134584:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140815744 00000100:00100000:2.0:1788917188.134588:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140815744 00000100:00100000:3.0:1788917188.134604:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788917188.134613:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140816000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917188.134650:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140816000:12345-0@lo:400:kworker.0 Request processed in 39us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917188.134774:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788917188.134786:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788917188.134797:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875815140815872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917188.134807:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788917188.134819:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140815744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917188.134849:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875815140815872:12345-0@lo:400:kworker.0 Request processed in 54us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917188.134858:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788917188.134871:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140815744:12345-0@lo:400:kworker.0 Request processed in 47us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917188.134881:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788917188.134910:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a6a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140815616:0@lo:400:kworker.0 00000100:00080000:3.0:1788917188.134921:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788917188.134929:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917188.134946:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a6a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140815744:0@lo:400:kworker.0 00000100:00100000:3.0:1788917188.134966:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140816000:0@lo:400:kworker.0 00000100:00100000:2.0:1788917188.134966:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875815140815872:0@lo:400:kworker.0 00000100:00100000:2.0:1788917188.135027:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a6a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140815488:0@lo:400:kworker.0 00000040:00080000:0.0:1788917188.351467:0:20401:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917188.351480:0:20401:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917188.352136:0:20401:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917188.352170:0:20401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917188.511382:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917189.535706:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917189.796198:0:20452:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917189.796205:0:20452:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917189.797207:0:20452:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917189.797216:0:20452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917190.535310:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917190.535359:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917190.535427:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113579264 00000100:00100000:0.0:1788917190.535451:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113579264 00000100:00100000:0.0:1788917190.535548:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 162 00000100:00100000:0.0:1788917190.535564:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2371:x1875815113579264:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917190.535700:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2371:x1875815113579264:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 140us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917190.535708:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 162 00000100:00100000:1.0:1788917190.536506:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113579520 00000100:00100000:1.0:1788917190.536516:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113579520 00000100:00080000:3.0:1788917190.536565:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917190.536602:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:1.0:1788917190.536613:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2371:x1875815113579520:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917190.536720:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2371:x1875815113579520:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 109us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917190.536727:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:3.0:1788917190.537007:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917190.537180:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917190.537470:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113579392 00000100:00100000:2.0:1788917190.537476:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113579392 00000100:00100000:2.0:1788917190.537531:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113579648 00000100:00100000:2.0:1788917190.537534:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113579648 00000100:00100000:2.0:1788917190.537558:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:2.0:1788917190.537564:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2371:x1875815113579392:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917190.537600:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2371:x1875815113579392:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 36us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917190.537604:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:2.0:1788917190.537615:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:2.0:1788917190.537619:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e28d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2371:x1875815113579648:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917190.537634:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e28d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2371:x1875815113579648:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 15us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917190.537637:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00080000:3.0:1788917190.537727:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788917190.561913:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917191.199314:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140816128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788917191.199408:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917191.199461:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140816128 00000100:00100000:3.0:1788917191.199483:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140816128 00000100:00100000:3.0:1788917191.199568:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788917191.199581:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140816128:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788917191.199583:0:14905:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788917191.199597:0:14905:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1788917191.199634:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788917191.199716:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140816128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917191.199725:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788917191.199752:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788917191.199798:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140816128:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788917191.216379:0:20505:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917191.216393:0:20505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917191.216925:0:20505:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917191.216934:0:20505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917191.583317:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917192.582373:0:20556:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917192.582385:0:20556:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917192.582950:0:20556:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917192.582959:0:20556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788917192.607313:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917193.247445:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140816512:0@lo:400:kworker.0 00000100:00100000:3.0:1788917193.247531:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140816768:0@lo:400:kworker.0 00000100:00100000:2.0:1788917193.247541:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917193.247630:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e28d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140816256:0@lo:400:kworker.0 00000100:00100000:1.0:1788917193.247718:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140816640:0@lo:400:kworker.0 00000100:00100000:3.0:1788917193.247814:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917193.247853:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140816512 00000100:00100000:3.0:1788917193.247861:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140816512 00000100:00100000:0.0:1788917193.248018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917193.248117:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788917193.248127:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140816512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917193.248266:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140816512:12345-0@lo:400:kworker.0 Request processed in 139us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917193.248281:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788917193.248309:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140816768 00000100:00100000:3.0:1788917193.248313:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140816768 00000100:00100000:3.0:1788917193.248371:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788917193.248381:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140816768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917193.248409:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140816512:0@lo:400:kworker.0 00000100:00100000:2.0:1788917193.248434:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140817024:0@lo:400:kworker.0 00000100:00100000:0.0:1788917193.248561:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140816384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917193.249139:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917193.249249:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140816768:12345-0@lo:400:kworker.0 Request processed in 870us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917193.249255:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788917193.249270:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140816640 00000100:00100000:1.0:1788917193.249275:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140816640 00000100:00100000:3.0:1788917193.249278:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140816256 00000100:00100000:3.0:1788917193.249282:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140816256 00000100:00100000:3.0:1788917193.249305:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788917193.249310:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140816256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917193.249320:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788917193.249331:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140816640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917193.249339:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37124050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140816256:12345-0@lo:400:kworker.0 Request processed in 29us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917193.249344:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1788917193.249367:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788917193.249370:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917193.249383:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140816640:12345-0@lo:400:kworker.0 Request processed in 55us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917193.249392:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788917193.249399:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140816768:0@lo:400:kworker.0 00000100:00100000:1.0:1788917193.249439:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140816640:0@lo:400:kworker.0 00000100:00100000:2.0:1788917193.249464:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917193.249496:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140817024 00000100:00100000:1.0:1788917193.249501:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140817024 00000100:00100000:1.0:1788917193.249542:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788917193.249550:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140817024:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788917193.249558:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917193.249614:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140817024:0@lo:400:kworker.0 00000100:00100000:1.0:1788917193.249614:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140817024:12345-0@lo:400:kworker.0 Request processed in 65us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917193.249632:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788917193.250422:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917193.250448:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140816896:0@lo:400:kworker.0 00000100:00100000:0.0:1788917193.250473:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917193.250479:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140816384 00000100:00100000:2.0:1788917193.250485:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140816384 00000100:00100000:2.0:1788917193.250520:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788917193.250529:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140816384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788917193.250562:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917193.250613:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140816384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917193.250621:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788917193.250667:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e28d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140816256:0@lo:400:kworker.0 00000100:00100000:0.0:1788917193.250684:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140816384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917193.250736:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140816896 00000100:00100000:1.0:1788917193.250740:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140816896 00000100:00100000:1.0:1788917193.250781:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1788917193.250783:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917193.250791:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140816896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917193.250923:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140816896:12345-0@lo:400:kworker.0 Request processed in 134us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917193.250930:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788917193.250980:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140816896:0@lo:400:kworker.0 00010000:00010000:2.0:1788917193.631385:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917194.052029:0:20607:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917194.052044:0:20607:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917194.052520:0:20607:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917194.052528:0:20607:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917194.656850:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917195.359419:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917195.359430:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917195.360091:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917195.360101:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:2.0:1788917195.455859:0:20658:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917195.455874:0:20658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917195.456367:0:20658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917195.456377:0:20658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788917195.656308:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917195.656354:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917195.656386:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917195.656423:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917195.656435:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113580032 00000100:00100000:1.0:1788917195.656449:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113580032 00000100:00100000:3.0:1788917195.656469:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113579904 00000100:00100000:3.0:1788917195.656478:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113579904 00000100:00100000:2.0:1788917195.656502:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113580160 00000100:00100000:0.0:1788917195.656506:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113579776 00000100:00100000:2.0:1788917195.656507:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113580160 00000100:00100000:0.0:1788917195.656512:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113579776 00000100:00100000:3.0:1788917195.656542:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 133 00000100:00100000:2.0:1788917195.656550:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00100000:3.0:1788917195.656558:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2371:x1875815113579904:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917195.656559:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:2.0:1788917195.656560:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:2371:x1875815113580160:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917195.656566:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 164 00000100:00100000:1.0:1788917195.656574:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2371:x1875815113580032:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917195.656581:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2371:x1875815113579776:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917195.656678:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:2371:x1875815113580160:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 121us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917195.656686:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00100000:3.0:1788917195.656692:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2371:x1875815113579904:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 142us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917195.656698:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 133 00000100:00080000:2.0:1788917195.656710:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788917195.656715:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917195.656786:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2371:x1875815113580032:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 216us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917195.656853:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 80 00000100:00100000:0.0:1788917195.657352:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37126c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2371:x1875815113579776:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 777us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917195.657360:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 164 00010000:00010000:3.0:1788917195.680127:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917196.319403:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140817152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917196.319509:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917196.319562:0:20500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140817152 00000100:00100000:0.0:1788917196.319572:0:20500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140817152 00000100:00080000:2.0:1788917196.319623:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917196.319671:0:20500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788917196.319683:0:20500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140817152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788917196.319728:0:20500:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917196.319785:0:20500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140817152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917196.319794:0:20500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788917196.319836:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140817152:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788917196.705029:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917196.857930:0:20709:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917196.857944:0:20709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917196.858572:0:20709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917196.858586:0:20709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917197.727403:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917198.367346:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788917198.367369:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140817280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917198.367435:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d010f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140817408:0@lo:400:kworker.0 00000100:00100000:3.0:1788917198.367445:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917198.367492:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917198.367513:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d010f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140817536:0@lo:400:kworker.0 00000100:00100000:0.0:1788917198.367529:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d010f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140817792:0@lo:400:kworker.0 00000100:00100000:2.0:1788917198.367537:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140817280 00000100:00100000:2.0:1788917198.367546:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140817280 00000100:00100000:3.0:1788917198.367554:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917198.367571:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917198.367582:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d010f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140818048:0@lo:400:kworker.0 00000100:00100000:0.0:1788917198.367620:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788917198.367631:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917198.367631:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d010f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140817664:0@lo:400:kworker.0 00000100:00100000:2.0:1788917198.367636:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788917198.367650:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140817280:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917198.367664:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788917198.367670:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917198.367675:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d010f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875815140817920:0@lo:400:kworker.0 00002000:00000024:2.0:1788917198.367690:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788917198.367709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917198.367746:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140817792 00000100:00100000:2.0:1788917198.367751:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140817280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917198.367752:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140817792 00000100:00100000:2.0:1788917198.367762:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788917198.367787:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140818048 00000100:00080000:2.0:1788917198.367788:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788917198.367792:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140818048 00000100:00080000:2.0:1788917198.367819:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917198.367823:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140817920 00000100:00100000:0.0:1788917198.367834:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140817920 00000100:00100000:0.0:1788917198.367863:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788917198.367870:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140817792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917198.367901:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140817280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917198.367913:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140817792:12345-0@lo:400:kworker.0 Request processed in 41us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917198.367920:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788917198.367937:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788917198.367939:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140817408 00000100:00100000:3.0:1788917198.367944:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140817408 00000100:00100000:0.0:1788917198.367945:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140818048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917198.367986:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00080000:2.0:1788917198.367986:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917198.367991:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140818048:12345-0@lo:400:kworker.0 Request processed in 46us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917198.367999:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140817408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917198.368001:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788917198.368018:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788917198.368026:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875815140817920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917198.368046:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37127c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140817408:12345-0@lo:400:kworker.0 Request processed in 49us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917198.368054:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788917198.368065:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875815140817920:12345-0@lo:400:kworker.0 Request processed in 39us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917198.368072:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788917198.368090:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140817536 00000100:00100000:3.0:1788917198.368095:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140817536 00000100:00100000:0.0:1788917198.368098:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140817664 00000100:00100000:0.0:1788917198.368103:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140817664 00000100:00100000:0.0:1788917198.368134:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1788917198.368136:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917198.368167:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140817664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917198.368174:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788917198.368187:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140817536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917198.368207:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140817664:12345-0@lo:400:kworker.0 Request processed in 66us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917198.368214:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788917198.368242:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140817536:12345-0@lo:400:kworker.0 Request processed in 57us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917198.368250:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788917198.368413:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d010f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875815140817920:0@lo:400:kworker.0 00000100:00100000:3.0:1788917198.368424:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d010f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140817536:0@lo:400:kworker.0 00000100:00100000:3.0:1788917198.368432:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d010f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140818048:0@lo:400:kworker.0 00000100:00100000:0.0:1788917198.368773:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d010f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140817664:0@lo:400:kworker.0 00000100:00100000:0.0:1788917198.368783:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d010f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140817408:0@lo:400:kworker.0 00000100:00100000:0.0:1788917198.368803:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d010f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140817792:0@lo:400:kworker.0 00000040:00080000:2.0:1788917198.386192:0:20761:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917198.386200:0:20761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917198.386751:0:20761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917198.386759:0:20761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788917198.751386:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917199.755746:0:20812:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917199.755755:0:20812:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917199.756303:0:20812:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917199.756311:0:20812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788917199.780168:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917200.774826:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917200.774931:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113580416 00000100:00100000:1.0:1788917200.774942:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113580416 00000100:00100000:1.0:1788917200.775079:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00100000:1.0:1788917200.775091:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113580416:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917200.775211:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113580416:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 122us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917200.775219:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00080000:2.0:1788917200.776899:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917200.780316:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917200.780362:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917200.780556:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113580288 00000100:00100000:0.0:1788917200.780566:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113580288 00000100:00100000:0.0:1788917200.780642:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 166 00000100:00100000:0.0:1788917200.780653:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113580288:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917200.780728:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37124450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113580288:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 77us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917200.780736:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 166 00000100:00100000:3.0:1788917200.781050:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113580672 00000100:00100000:3.0:1788917200.781055:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113580672 00000100:00100000:3.0:1788917200.781196:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 139 00000100:00100000:3.0:1788917200.781205:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113580672:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917200.781255:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113580672:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 51us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917200.781262:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 139 00000100:00080000:2.0:1788917200.785121:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917200.787512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917200.787580:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113580544 00000100:00100000:1.0:1788917200.787603:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113580544 00000100:00080000:2.0:1788917200.787655:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917200.787679:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 83 00000100:00100000:1.0:1788917200.787691:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113580544:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917200.787779:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113580544:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 90us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917200.787787:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 83 00010000:00010000:1.0:1788917200.800713:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917201.144915:0:20863:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917201.144924:0:20863:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917201.145542:0:20863:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917201.145551:0:20863:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917201.441000:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788917201.441026:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140818176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917201.441106:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917201.441554:0:20500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140818176 00000100:00100000:2.0:1788917201.441564:0:20500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140818176 00000100:00100000:2.0:1788917201.441821:0:20500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788917201.441831:0:20500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140818176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788917201.441870:0:20500:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917201.441939:0:20500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140818176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917201.441946:0:20500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788917201.442008:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140818176:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788917201.442081:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788917201.823771:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917202.568827:0:20914:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917202.568836:0:20914:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917202.569393:0:20914:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917202.569403:0:20914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788917202.847381:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917203.487333:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788917203.487350:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140818560:0@lo:400:kworker.0 00000100:00100000:2.0:1788917203.487355:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140818688:0@lo:400:kworker.0 00000100:00100000:1.0:1788917203.487392:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140818432:0@lo:400:kworker.0 00000100:00100000:3.0:1788917203.487443:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917203.487445:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917203.487481:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140818432 00000100:00100000:2.0:1788917203.487487:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140818432 00000100:00100000:1.0:1788917203.487515:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140818944:0@lo:400:kworker.0 00000100:00100000:3.0:1788917203.487522:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140819072:0@lo:400:kworker.0 00000100:00100000:2.0:1788917203.487544:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788917203.487556:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140818432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917203.487576:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917203.487593:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917203.487635:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140818304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788917203.487647:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37125450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140818432:12345-0@lo:400:kworker.0 Request processed in 93us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917203.487652:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140818432:0@lo:400:kworker.0 00000100:00100000:2.0:1788917203.487669:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788917203.487670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917203.487685:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140818816:0@lo:400:kworker.0 00000100:00100000:0.0:1788917203.487695:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140818560 00000100:00100000:0.0:1788917203.487702:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140818560 00000100:00100000:1.0:1788917203.487716:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917203.487727:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140818304 00000100:00100000:2.0:1788917203.487729:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140818688 00000100:00100000:3.0:1788917203.487733:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140818304 00000100:00100000:2.0:1788917203.487734:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140818688 00000100:00100000:0.0:1788917203.487749:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788917203.487760:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140818560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917203.487765:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140818944 00000100:00100000:1.0:1788917203.487770:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140818944 00000100:00100000:2.0:1788917203.487775:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788917203.487788:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788917203.487789:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875815140818688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917203.487803:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875815140818304:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917203.487813:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140818816 00000100:00100000:1.0:1788917203.487818:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140818816 00000100:00100000:2.0:1788917203.487835:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875815140818688:12345-0@lo:400:kworker.0 Request processed in 52us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917203.487841:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788917203.487846:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788917203.487853:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140818560:12345-0@lo:400:kworker.0 Request processed in 43us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917203.487857:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e03855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140818944:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788917203.487868:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917203.487869:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788917203.487871:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788917203.487875:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788917203.487879:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917203.487883:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140818816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917203.487902:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e03855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140818944:12345-0@lo:400:kworker.0 Request processed in 47us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917203.487910:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00002000:00000024:3.0:1788917203.487914:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917203.487924:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140818816:12345-0@lo:400:kworker.0 Request processed in 45us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917203.487930:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788917203.487943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917203.487953:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140818304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917203.487960:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788917203.487969:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140818816:0@lo:400:kworker.0 00000100:00100000:1.0:1788917203.487981:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140818560:0@lo:400:kworker.0 00000100:00100000:3.0:1788917203.488004:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140819072 00000100:00100000:2.0:1788917203.488007:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140818688:0@lo:400:kworker.0 00000100:00100000:3.0:1788917203.488010:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140819072 00000100:00100000:1.0:1788917203.488027:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140818944:0@lo:400:kworker.0 00000100:00100000:2.0:1788917203.488049:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140818304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917203.488053:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788917203.488063:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140819072:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788917203.488089:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917203.488114:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c992300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140819072:12345-0@lo:400:kworker.0 Request processed in 53us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917203.488122:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788917203.488184:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140819072:0@lo:400:kworker.0 00010000:00010000:1.0:1788917203.871570:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917203.970480:0:20965:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917203.970489:0:20965:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917203.971036:0:20965:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917203.971045:0:20965:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788917204.895567:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917205.424354:0:21017:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917205.424363:0:21017:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917205.424988:0:21017:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917205.424997:0:21017:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:1.0:1788917205.599623:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917205.599633:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917205.601949:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917205.601965:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917205.894909:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917205.894949:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917205.894989:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917205.895022:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113580928 00000100:00100000:2.0:1788917205.895209:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113580928 00000100:00100000:2.0:1788917205.895325:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113581184 00000100:00100000:2.0:1788917205.895329:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113581184 00000100:00100000:2.0:1788917205.895362:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 143 00000100:00100000:2.0:1788917205.895374:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113580928:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917205.895423:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 144 00000100:00100000:3.0:1788917205.895436:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113581184:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917205.895495:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c992d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113580928:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 120us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917205.895496:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113581184:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 60us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917205.895516:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 143 00000100:00080000:2.0:1788917205.895567:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917205.895843:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 144 00000100:00100000:2.0:1788917205.896034:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917205.896086:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113580800 00000100:00100000:0.0:1788917205.896092:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113580800 00000100:00100000:0.0:1788917205.896136:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 168 00000100:00100000:0.0:1788917205.896171:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2373:x1875815113580800:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917205.896217:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37125c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2373:x1875815113580800:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 72us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917205.896223:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113581056 00000100:00100000:1.0:1788917205.896228:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113581056 00000100:00100000:0.0:1788917205.896239:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 168 00000100:00100000:1.0:1788917205.896281:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:1.0:1788917205.896290:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2373:x1875815113581056:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917205.896325:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2373:x1875815113581056:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 38us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917205.896331:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00080000:3.0:1788917205.896445:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788917205.919588:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917206.559873:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788917206.559896:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140819200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917206.559973:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917206.560213:0:20500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140819200 00000100:00100000:2.0:1788917206.560222:0:20500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140819200 00000100:00100000:2.0:1788917206.560289:0:20500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788917206.560300:0:20500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140819200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788917206.560336:0:20500:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917206.560389:0:20500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c990a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140819200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917206.560397:0:20500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788917206.560440:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140819200:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788917206.560474:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788917206.914302:0:21068:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917206.914313:0:21068:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917206.914839:0:21068:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917206.914872:0:21068:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917206.943303:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917207.968368:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917208.466299:0:21119:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917208.466313:0:21119:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917208.466913:0:21119:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917208.466922:0:21119:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917208.607369:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140819328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788917208.607401:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140819456:0@lo:400:kworker.0 00000100:00100000:0.0:1788917208.607498:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140819584:0@lo:400:kworker.0 00000100:00100000:3.0:1788917208.607524:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140819712:0@lo:400:kworker.0 00000100:00100000:2.0:1788917208.607942:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917208.607942:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917208.607997:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140819968:0@lo:400:kworker.0 00000100:00100000:2.0:1788917208.608023:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917208.608072:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140819840:0@lo:400:kworker.0 00000100:00100000:2.0:1788917208.608088:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140819456 00000100:00100000:2.0:1788917208.608097:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140819456 00000100:00100000:1.0:1788917208.608104:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917208.608169:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788917208.608179:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140819456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917208.608232:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37125050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140819456:12345-0@lo:400:kworker.0 Request processed in 54us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917208.608239:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788917208.608277:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140819968 00000100:00100000:2.0:1788917208.608281:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140819968 00000100:00100000:2.0:1788917208.608330:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140819840 00000100:00100000:2.0:1788917208.608334:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140819840 00000100:00100000:2.0:1788917208.608352:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788917208.608358:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140819968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917208.608391:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140819968:12345-0@lo:400:kworker.0 Request processed in 33us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917208.608397:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788917208.608408:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788917208.608415:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140819840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917208.608447:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c991c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140819840:12345-0@lo:400:kworker.0 Request processed in 33us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917208.608454:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1788917208.608476:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917208.608614:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140819328 00000100:00100000:1.0:1788917208.608619:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140819328 00000100:00100000:1.0:1788917208.608663:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788917208.608672:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140819328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788917208.608706:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917208.608746:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140819328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917208.608760:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788917208.608927:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788917208.609007:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140819840:0@lo:400:kworker.0 00000100:00100000:2.0:1788917208.609023:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140819328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788917208.609053:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140819456:0@lo:400:kworker.0 00000100:00100000:2.0:1788917208.609063:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140819968:0@lo:400:kworker.0 00000100:00100000:0.0:1788917208.609462:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917208.609578:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140819584 00000100:00100000:2.0:1788917208.609583:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140819584 00000100:00100000:2.0:1788917208.609670:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788917208.609677:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140819584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917208.609812:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140819584:12345-0@lo:400:kworker.0 Request processed in 135us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917208.609818:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1788917208.609843:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917208.611393:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140819584:0@lo:400:kworker.0 00000100:00100000:0.0:1788917208.611420:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140820096:0@lo:400:kworker.0 00000100:00100000:0.0:1788917208.611521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917208.611993:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917208.612095:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140819712 00000100:00100000:1.0:1788917208.612105:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140819712 00000100:00100000:1.0:1788917208.612235:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788917208.612245:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140819712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917208.612332:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140819712:12345-0@lo:400:kworker.0 Request processed in 88us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917208.612340:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788917208.612538:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140819712:0@lo:400:kworker.0 00000100:00100000:3.0:1788917208.613032:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140820096 00000100:00100000:3.0:1788917208.613040:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140820096 00000100:00100000:3.0:1788917208.613099:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788917208.613107:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140820096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917208.613195:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140820096:12345-0@lo:400:kworker.0 Request processed in 89us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917208.613203:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1788917208.613243:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917208.616705:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140820096:0@lo:400:kworker.0 00010000:00010000:3.0:1788917208.991706:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917209.863937:0:21170:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917209.863947:0:21170:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917209.864512:0:21170:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917209.864521:0:21170:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917210.015566:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917211.015462:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917211.015833:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113581440 00000100:00100000:0.0:1788917211.015843:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113581440 00000100:00100000:0.0:1788917211.015934:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 148 00000100:00100000:0.0:1788917211.015952:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113581440:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:3.0:1788917211.015976:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917211.016744:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917211.016784:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113581312 00000100:00100000:1.0:1788917211.016790:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113581312 00000100:00100000:2.0:1788917211.016811:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917211.016837:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 170 00000100:00100000:2.0:1788917211.016841:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113581568 00000100:00100000:2.0:1788917211.016846:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113581568 00000100:00100000:1.0:1788917211.016848:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113581312:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:3.0:1788917211.016877:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917211.016898:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:2.0:1788917211.016907:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113581568:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917211.016944:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113581568:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 39us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917211.016950:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:1.0:1788917211.016959:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113581312:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 112us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917211.016968:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 170 00000100:00100000:0.0:1788917211.017204:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113581440:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 1260us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917211.017381:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 148 00000100:00100000:2.0:1788917211.018551:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917211.018645:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113581696 00000100:00100000:0.0:1788917211.018651:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113581696 00000100:00080000:3.0:1788917211.018695:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917211.018737:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 149 00000100:00100000:0.0:1788917211.018746:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113581696:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917211.018793:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113581696:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 48us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917211.018800:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 149 00010000:00010000:0.0:1788917211.039346:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917211.269208:0:21221:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917211.269217:0:21221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917211.269792:0:21221:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917211.269799:0:21221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788917211.679842:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140820224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788917211.681353:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917211.681681:0:20500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140820224 00000100:00100000:3.0:1788917211.681691:0:20500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140820224 00000100:00100000:3.0:1788917211.681753:0:20500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788917211.681765:0:20500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140820224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788917211.681802:0:20500:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788917211.681889:0:20500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140820224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917211.681895:0:20500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788917211.681936:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917211.681988:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140820224:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788917212.063332:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917212.635571:0:21273:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917212.635580:0:21273:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917212.636498:0:21273:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917212.636509:0:21273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917213.088026:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917213.727315:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140820480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917213.727364:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d010f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140820352:0@lo:400:kworker.0 00000100:00100000:3.0:1788917213.727392:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917213.727411:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917213.727447:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d010f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140820864:0@lo:400:kworker.0 00000100:00100000:0.0:1788917213.727475:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d010f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140820992:0@lo:400:kworker.0 00000100:00100000:3.0:1788917213.727489:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917213.727518:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917213.727522:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788917213.727529:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d010f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140820736:0@lo:400:kworker.0 00000100:00100000:0.0:1788917213.727554:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788917213.727560:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917213.727566:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d010f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140820608:0@lo:400:kworker.0 00000100:00100000:3.0:1788917213.727597:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140820480 00000100:00100000:0.0:1788917213.727603:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917213.727604:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140820480 00000100:00100000:1.0:1788917213.727613:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140820352 00000100:00100000:1.0:1788917213.727620:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140820352 00000100:00100000:0.0:1788917213.727636:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d010f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140821120:0@lo:400:kworker.0 00000100:00100000:3.0:1788917213.727661:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788917213.727668:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788917213.727669:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917213.727674:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140820480:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917213.727683:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140820352:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788917213.727707:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917213.727721:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140820864 00000100:00100000:0.0:1788917213.727727:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140820864 00000100:00100000:3.0:1788917213.727740:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140820480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917213.727746:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788917213.727762:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140820992 00000100:00100000:3.0:1788917213.727767:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140821120 00000100:00100000:0.0:1788917213.727767:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140820992 00000100:00100000:3.0:1788917213.727773:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140821120 00000100:00100000:0.0:1788917213.727803:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788917213.727812:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140820864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917213.727856:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788917213.727859:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140820864:12345-0@lo:400:kworker.0 Request processed in 45us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917213.727867:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140820992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917213.727867:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140820352:12345-0@lo:400:kworker.0 Request processed in 185us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917213.727875:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788917213.727884:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788917213.727898:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788917213.727908:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140821120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917213.727929:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140820992:12345-0@lo:400:kworker.0 Request processed in 65us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917213.727935:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788917213.727951:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140821120:12345-0@lo:400:kworker.0 Request processed in 45us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917213.727959:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140820736 00000100:00100000:3.0:1788917213.727963:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140820736 00000100:00100000:1.0:1788917213.727971:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140820608 00000100:00100000:1.0:1788917213.727977:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140820608 00000100:00100000:3.0:1788917213.727990:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788917213.727999:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140820736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917213.728017:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1788917213.728021:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788917213.728027:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917213.728028:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140820736:12345-0@lo:400:kworker.0 Request processed in 30us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917213.728030:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140820608:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788917213.728031:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788917213.728047:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788917213.728074:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140820608:12345-0@lo:400:kworker.0 Request processed in 49us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917213.728081:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788917213.728111:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d010f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140820736:0@lo:400:kworker.0 00000100:00100000:3.0:1788917213.728129:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d010f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140820864:0@lo:400:kworker.0 00000100:00100000:1.0:1788917213.728141:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d010f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140820608:0@lo:400:kworker.0 00000100:00100000:3.0:1788917213.728193:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140820480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917213.728485:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d010f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140821120:0@lo:400:kworker.0 00000100:00100000:1.0:1788917213.728494:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d010f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140820352:0@lo:400:kworker.0 00000100:00100000:1.0:1788917213.728504:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d010f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140820992:0@lo:400:kworker.0 00000100:00100000:0.0:1788917213.728809:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000040:00080000:2.0:1788917214.038585:0:21324:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917214.038600:0:21324:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917214.039124:0:21324:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917214.039132:0:21324:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917214.112269:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917215.135328:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917215.500639:0:21375:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917215.500646:0:21375:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917215.501603:0:21375:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917215.501614:0:21375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:1.0:1788917215.839375:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917215.839384:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917215.839920:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917215.839933:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917216.135929:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917216.135974:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917216.136000:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113581824 00000100:00100000:0.0:1788917216.136011:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113581824 00000100:00100000:1.0:1788917216.136052:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917216.136085:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 172 00000100:00100000:1.0:1788917216.136094:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917216.136103:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113581824:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917216.136180:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113582080 00000100:00100000:2.0:1788917216.136185:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113582080 00000100:00100000:0.0:1788917216.136217:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113581824:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 116us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917216.136228:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 172 00000100:00100000:2.0:1788917216.136233:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 92 00000100:00100000:2.0:1788917216.136258:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113582080:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917216.136293:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d154380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113582080:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 39us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917216.136300:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 92 00000100:00080000:2.0:1788917216.136353:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788917216.137942:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113581952 00000100:00100000:3.0:1788917216.137954:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113581952 00000100:00100000:3.0:1788917216.138014:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113582208 00000100:00100000:3.0:1788917216.138018:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113582208 00000100:00100000:3.0:1788917216.138043:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 153 00000100:00100000:3.0:1788917216.138051:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113581952:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917216.138121:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113581952:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 70us (2146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917216.138128:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 153 00000100:00100000:3.0:1788917216.138142:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 154 00000100:00100000:3.0:1788917216.138170:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113582208:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917216.138194:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113582208:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 25us (2101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917216.138199:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 154 00000100:00080000:0.0:1788917216.141544:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788917216.159379:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917216.800333:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788917216.800360:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140821248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917216.800421:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917216.800510:0:20500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140821248 00000100:00100000:3.0:1788917216.800517:0:20500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140821248 00000100:00080000:2.0:1788917216.800564:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788917216.800581:0:20500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788917216.800591:0:20500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140821248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788917216.800632:0:20500:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788917216.800688:0:20500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140821248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917216.800695:0:20500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788917216.800772:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140821248:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788917216.966052:0:21426:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917216.966063:0:21426:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917216.966782:0:21426:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917216.966791:0:21426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917217.183300:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917218.207800:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917218.475577:0:21478:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917218.475586:0:21478:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917218.476065:0:21478:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917218.476081:0:21478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917218.847428:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d010f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140821376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917218.847518:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917218.847593:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140821888:0@lo:400:kworker.0 00000100:00100000:2.0:1788917218.847600:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140821376 00000100:00100000:2.0:1788917218.847608:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140821376 00000100:00100000:3.0:1788917218.847629:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917218.847653:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788917218.847655:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140821632:0@lo:400:kworker.0 00000100:00100000:3.0:1788917218.847663:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140821760:0@lo:400:kworker.0 00000100:00100000:2.0:1788917218.847676:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788917218.847690:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140821376:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917218.847698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788917218.847714:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788917218.847733:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917218.847734:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140822144:0@lo:400:kworker.0 00000100:00100000:3.0:1788917218.847752:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140821632 00000100:00100000:3.0:1788917218.847757:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140821632 00000100:00100000:1.0:1788917218.847767:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917218.847798:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140821376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917218.847806:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788917218.847808:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788917218.847817:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140821632:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788917218.847843:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788917218.847858:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140821632:12345-0@lo:400:kworker.0 Request processed in 43us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917218.847866:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917218.847926:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788917218.847940:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140821760 00000100:00100000:3.0:1788917218.847944:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140821760 00000100:00100000:2.0:1788917218.849039:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d010f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140821376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917218.849109:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140821504:0@lo:400:kworker.0 00000100:00100000:3.0:1788917218.849164:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788917218.849170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917218.849180:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140821760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917218.849208:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140822016:0@lo:400:kworker.0 00000100:00100000:3.0:1788917218.849231:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140821760:12345-0@lo:400:kworker.0 Request processed in 55us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917218.849240:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917218.849548:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140821888 00000100:00100000:0.0:1788917218.849554:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140821888 00000100:00100000:0.0:1788917218.849583:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140822144 00000100:00100000:0.0:1788917218.849585:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140822144 00000100:00100000:0.0:1788917218.849621:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140822016 00000100:00100000:0.0:1788917218.849624:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140822016 00000100:00100000:0.0:1788917218.849638:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788917218.849643:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e1ebce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140821888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917218.849679:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e1ebce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140821888:12345-0@lo:400:kworker.0 Request processed in 34us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917218.849685:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788917218.849698:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788917218.849704:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140822144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917218.849716:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140821632:0@lo:400:kworker.0 00000100:00100000:0.0:1788917218.849735:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875815140822144:12345-0@lo:400:kworker.0 Request processed in 31us (1968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917218.849742:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788917218.849755:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788917218.849758:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875815140822144:0@lo:400:kworker.0 00000100:00100000:0.0:1788917218.849765:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140822016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917218.849803:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140822016:12345-0@lo:400:kworker.0 Request processed in 40us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917218.849810:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788917218.849815:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140821504 00000100:00100000:1.0:1788917218.849819:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140821504 00000100:00100000:0.0:1788917218.849845:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140822016:0@lo:400:kworker.0 00000100:00100000:1.0:1788917218.849850:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788917218.849859:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140821504:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788917218.849902:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917218.849903:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140821504:12345-0@lo:400:kworker.0 Request processed in 45us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917218.849913:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788917218.849935:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140821760:0@lo:400:kworker.0 00000100:00100000:0.0:1788917218.849949:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140821888:0@lo:400:kworker.0 00000100:00100000:1.0:1788917218.849959:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140821504:0@lo:400:kworker.0 00000100:00100000:3.0:1788917218.850469:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00010000:1.0:1788917219.234656:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917219.837437:0:21530:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917219.837447:0:21530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917219.837926:0:21530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917219.837937:0:21530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917220.255283:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917221.217608:0:21581:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917221.217615:0:21581:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917221.218034:0:21581:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917221.218042:0:21581:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788917221.255504:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917221.255546:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917221.255571:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113582336 00000100:00100000:0.0:1788917221.255580:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917221.255583:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113582336 00000100:00100000:2.0:1788917221.255590:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113582592 00000100:00100000:2.0:1788917221.255598:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113582592 00000100:00100000:1.0:1788917221.255640:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 174 00000100:00100000:1.0:1788917221.255651:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113582336:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917221.255659:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 95 00000100:00100000:0.0:1788917221.255673:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917221.255674:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113582592:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917221.255708:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113582464 00000100:00100000:0.0:1788917221.255712:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113582464 00000100:00100000:1.0:1788917221.255727:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113582336:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 78us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917221.255734:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113582592:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 66us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917221.255745:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113582720 00000100:00100000:0.0:1788917221.255748:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113582720 00000100:00100000:1.0:1788917221.255751:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 174 00000100:00100000:2.0:1788917221.255752:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 95 00000100:00100000:0.0:1788917221.255773:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 158 00000100:00100000:0.0:1788917221.255784:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2374:x1875815113582464:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:2.0:1788917221.255795:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917221.255804:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 159 00000100:00100000:1.0:1788917221.255812:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113582720:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:2.0:1788917221.255814:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917221.255821:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2374:x1875815113582464:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 39us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917221.255829:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 158 00000100:00100000:1.0:1788917221.255840:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113582720:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 29us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917221.255846:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 159 00010000:00010000:1.0:1788917221.279459:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917221.919500:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140822272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788917221.919594:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917221.919758:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140822272 00000100:00100000:1.0:1788917221.919768:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140822272 00000100:00100000:1.0:1788917221.919828:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788917221.919835:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140822272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788917221.919876:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917221.919925:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140822272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917221.919933:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788917221.919991:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917221.920056:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140822272:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788917222.304298:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917222.643262:0:21632:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917222.643271:0:21632:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917222.645287:0:21632:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917222.645302:0:21632:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917223.329254:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917223.967497:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d010f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140822400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917223.967564:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917223.967702:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140822400 00000100:00100000:0.0:1788917223.967710:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140822400 00000100:00100000:0.0:1788917223.967770:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788917223.967780:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140822400:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917223.967806:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140822528:0@lo:400:kworker.0 00002000:00000024:0.0:1788917223.967817:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788917223.967845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917223.967975:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140822400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 196us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917223.967983:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788917223.968002:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140823040:0@lo:400:kworker.0 00000100:00100000:3.0:1788917223.968043:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788917223.968060:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788917223.968079:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788917223.968086:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140823040 00000100:00100000:3.0:1788917223.968088:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140822656:0@lo:400:kworker.0 00000100:00100000:0.0:1788917223.968091:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140823040 00000100:00100000:3.0:1788917223.968121:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917223.968134:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788917223.968166:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140823040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917223.968177:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140822528 00000100:00100000:3.0:1788917223.968182:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140822528 00000100:00100000:0.0:1788917223.968210:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01ccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140823040:12345-0@lo:400:kworker.0 Request processed in 68us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917223.968216:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788917223.968220:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788917223.968228:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140822528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917223.968250:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140822784:0@lo:400:kworker.0 00000100:00100000:3.0:1788917223.968265:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140822528:12345-0@lo:400:kworker.0 Request processed in 39us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917223.968272:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788917223.968283:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917223.968308:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140822656 00000100:00100000:0.0:1788917223.968308:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788917223.968313:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140822656 00000100:00100000:0.0:1788917223.968317:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e1ebcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140822912:0@lo:400:kworker.0 00000100:00100000:0.0:1788917223.968345:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917223.968348:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788917223.968359:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140822656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917223.968392:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140822784 00000100:00100000:0.0:1788917223.968397:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140822784 00000100:00100000:3.0:1788917223.968407:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01ccf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140822656:12345-0@lo:400:kworker.0 Request processed in 50us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917223.968414:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788917223.968427:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140822912 00000100:00100000:0.0:1788917223.968432:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140822912 00000100:00100000:0.0:1788917223.968459:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788917223.968465:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140822784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917223.968507:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875815140822784:12345-0@lo:400:kworker.0 Request processed in 42us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917223.968514:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788917223.968529:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788917223.968537:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875815140822784:0@lo:400:kworker.0 00000100:00100000:0.0:1788917223.968537:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140822912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917223.968581:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140822912:12345-0@lo:400:kworker.0 Request processed in 45us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917223.968589:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788917223.968593:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140822912:0@lo:400:kworker.0 00000100:00080000:0.0:1788917223.969070:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788917223.969080:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917223.969107:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d010f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140822400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917223.969139:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140822656:0@lo:400:kworker.0 00000100:00100000:0.0:1788917223.969169:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140822528:0@lo:400:kworker.0 00000100:00100000:0.0:1788917223.969178:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e1ebcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140823040:0@lo:400:kworker.0 00000040:00080000:3.0:1788917224.129422:0:21683:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917224.129433:0:21683:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917224.131061:0:21683:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917224.131078:0:21683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917224.351454:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917225.055435:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917225.055444:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917225.057129:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917225.057158:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917225.380085:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917225.667319:0:21734:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917225.667329:0:21734:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917225.668944:0:21734:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917225.668957:0:21734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917226.377393:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917226.377443:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917226.377471:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113582848 00000100:00100000:3.0:1788917226.377478:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917226.377483:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113582848 00000100:00100000:1.0:1788917226.377541:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 176 00000100:00100000:3.0:1788917226.377542:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917226.377556:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113582848:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917226.377573:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113583104 00000100:00100000:3.0:1788917226.377579:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113583104 00000100:00100000:3.0:1788917226.377626:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 97 00000100:00100000:3.0:1788917226.377637:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113583104:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917226.377643:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113582976 00000100:00100000:2.0:1788917226.377648:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113583232 00000100:00100000:0.0:1788917226.377649:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113582976 00000100:00100000:1.0:1788917226.377654:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113582848:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 99us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917226.377658:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113583232 00000100:00100000:1.0:1788917226.377665:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 176 00000100:00100000:3.0:1788917226.377690:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113583104:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 55us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917226.377699:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 97 00000100:00100000:0.0:1788917226.377704:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 163 00000100:00100000:0.0:1788917226.377716:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113582976:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917226.377720:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 164 00000100:00080000:1.0:1788917226.377723:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788917226.377730:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917226.377737:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113583232:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917226.377761:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113582976:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 46us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917226.377769:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 163 00000100:00100000:2.0:1788917226.377778:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113583232:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 45us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917226.377787:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 164 00010000:00010000:0.0:1788917226.399296:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917227.040270:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d010f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140823168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788917227.040358:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917227.040442:0:20500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140823168 00000100:00100000:0.0:1788917227.040451:0:20500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140823168 00000100:00100000:0.0:1788917227.040513:0:20500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788917227.040523:0:20500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3baa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140823168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788917227.040566:0:20500:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917227.040611:0:20500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3baa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140823168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917227.040618:0:20500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788917227.040821:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917227.040853:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d010f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140823168:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788917227.120579:0:21786:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917227.120590:0:21786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917227.121505:0:21786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917227.121515:0:21786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917227.423464:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917228.447325:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917228.589320:0:21837:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917228.589345:0:21837:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917228.589858:0:21837:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917228.589867:0:21837:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917229.087493:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140823680:0@lo:400:kworker.0 00000100:00100000:0.0:1788917229.087699:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2cd30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140823424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917229.087761:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917229.087761:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917229.087830:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140823680 00000100:00100000:2.0:1788917229.087834:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140823552:0@lo:400:kworker.0 00000100:00100000:1.0:1788917229.087875:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140823680 00000100:00100000:3.0:1788917229.087937:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140823424 00000100:00100000:3.0:1788917229.087942:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140823424 00000100:00100000:0.0:1788917229.087972:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140823936:0@lo:400:kworker.0 00000100:00100000:1.0:1788917229.088002:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788917229.088009:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917229.088012:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788917229.088016:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140823680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917229.088035:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788917229.088045:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140823424:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917229.088045:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140823296:0@lo:400:kworker.0 00002000:00000024:3.0:1788917229.088081:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917229.088087:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917229.088096:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140823680:12345-0@lo:400:kworker.0 Request processed in 83us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917229.088105:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788917229.088126:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140823424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917229.088127:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140823808:0@lo:400:kworker.0 00000100:00100000:3.0:1788917229.088135:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1788917229.088176:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788917229.088184:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917229.088191:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140823296 00000100:00100000:3.0:1788917229.088195:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140823296 00000100:00100000:3.0:1788917229.088229:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788917229.088233:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2cd30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140823424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917229.088240:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140823296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917229.088269:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140823936 00000100:00100000:1.0:1788917229.088274:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140823680:0@lo:400:kworker.0 00000100:00100000:0.0:1788917229.088275:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140823936 00000100:00100000:3.0:1788917229.088286:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140823296:12345-0@lo:400:kworker.0 Request processed in 48us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917229.088294:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788917229.088335:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140823808 00000100:00100000:0.0:1788917229.088339:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140823808 00000100:00100000:3.0:1788917229.088350:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788917229.088360:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788917229.088362:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140823936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917229.088374:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140823808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917229.088402:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140823936:12345-0@lo:400:kworker.0 Request processed in 45us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917229.088404:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140823296:0@lo:400:kworker.0 00000100:00100000:3.0:1788917229.088411:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788917229.088430:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140823808:12345-0@lo:400:kworker.0 Request processed in 58us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917229.088430:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140823808:0@lo:400:kworker.0 00000100:00080000:3.0:1788917229.088444:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917229.088445:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788917229.088452:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140823936:0@lo:400:kworker.0 00000100:00100000:2.0:1788917229.089163:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917229.089197:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140824064:0@lo:400:kworker.0 00000100:00100000:3.0:1788917229.089214:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140823552 00000100:00100000:3.0:1788917229.089220:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140823552 00000100:00100000:2.0:1788917229.089226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917229.089268:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788917229.089278:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140823552:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788917229.089281:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917229.089350:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140824064 00000100:00100000:0.0:1788917229.089355:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140824064 00000100:00100000:0.0:1788917229.089427:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788917229.089433:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140824064:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788917229.089473:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917229.090751:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140824064:12345-0@lo:400:kworker.0 Request processed in 1316us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917229.090760:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788917229.092957:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140823552:12345-0@lo:400:kworker.0 Request processed in 3671us (3802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917229.092971:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788917229.093081:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140823552:0@lo:400:kworker.0 00000100:00100000:2.0:1788917229.093097:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01ccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140824064:0@lo:400:kworker.0 00010000:00010000:0.0:1788917229.471310:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917230.073522:0:21888:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917230.073532:0:21888:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917230.074081:0:21888:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917230.074089:0:21888:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917230.495332:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917231.464430:0:21939:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917231.464440:0:21939:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917231.465130:0:21939:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917231.465139:0:21939:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917231.494731:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917231.494773:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917231.494805:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917231.494870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917231.494918:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113583616 00000100:00100000:1.0:1788917231.494926:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113583616 00000100:00100000:2.0:1788917231.494959:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113583488 00000100:00100000:2.0:1788917231.494966:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113583488 00000100:00100000:1.0:1788917231.494984:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 100 00000100:00100000:1.0:1788917231.494997:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113583616:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917231.495000:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113583744 00000100:00100000:2.0:1788917231.495005:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113583744 00000100:00100000:2.0:1788917231.495024:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 168 00000100:00100000:2.0:1788917231.495037:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113583488:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917231.495077:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113583616:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 81us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917231.495078:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113583488:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 40us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917231.495096:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 168 00000100:00100000:1.0:1788917231.495098:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 100 00000100:00100000:2.0:1788917231.495121:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 169 00000100:00100000:2.0:1788917231.495127:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2cd30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113583744:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:1.0:1788917231.495131:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788917231.495137:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917231.495172:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2cd30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113583744:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 43us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917231.495180:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 169 00000100:00100000:0.0:1788917231.495361:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113583360 00000100:00100000:0.0:1788917231.495366:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113583360 00000100:00100000:0.0:1788917231.495406:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 178 00000100:00100000:0.0:1788917231.495414:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113583360:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917231.495456:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113583360:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 43us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917231.495461:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 178 00010000:00010000:1.0:1788917231.519528:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917232.159524:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d010f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140824192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917232.159629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917232.160069:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140824192 00000100:00100000:0.0:1788917232.160079:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140824192 00000100:00100000:0.0:1788917232.160167:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788917232.160179:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140824192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788917232.160219:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917232.160274:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140824192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917232.160282:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788917232.160324:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d010f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140824192:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788917232.160425:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788917232.543276:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917232.877824:0:21990:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917232.877836:0:21990:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917232.878482:0:21990:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917232.878492:0:21990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917233.567441:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917234.207380:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d010f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140824320:0@lo:400:kworker.0 00000100:00100000:0.0:1788917234.207439:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140824448:0@lo:400:kworker.0 00000100:00100000:3.0:1788917234.207454:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917234.207496:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917234.207517:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140824832:0@lo:400:kworker.0 00000100:00100000:0.0:1788917234.207526:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140824960:0@lo:400:kworker.0 00000100:00100000:3.0:1788917234.207561:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917234.207573:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140824576:0@lo:400:kworker.0 00000100:00100000:3.0:1788917234.207602:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140824320 00000100:00100000:0.0:1788917234.207608:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917234.207610:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140824320 00000100:00100000:0.0:1788917234.207650:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788917234.207658:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140824704:0@lo:400:kworker.0 00000100:00100000:3.0:1788917234.207665:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788917234.207676:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140824320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917234.207688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917234.207724:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140824832 00000100:00100000:0.0:1788917234.207728:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140824832 00000100:00100000:3.0:1788917234.207738:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140824320:12345-0@lo:400:kworker.0 Request processed in 63us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917234.207746:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788917234.207770:0:14266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140824704 00000100:00100000:0.0:1788917234.207775:0:14266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140824704 00000100:00100000:0.0:1788917234.207802:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788917234.207807:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d010f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140824320:0@lo:400:kworker.0 00000100:00100000:0.0:1788917234.207813:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140824832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917234.207848:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788917234.207856:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140824704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917234.207862:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140824832:12345-0@lo:400:kworker.0 Request processed in 51us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917234.207869:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788917234.207894:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140824704:12345-0@lo:400:kworker.0 Request processed in 39us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917234.207896:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140824448 00000100:00100000:0.0:1788917234.207901:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140824448 00000100:00100000:3.0:1788917234.207902:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788917234.207932:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140824576 00000100:00100000:0.0:1788917234.207936:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140824576 00000100:00080000:3.0:1788917234.207947:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788917234.207952:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788917234.207955:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917234.207969:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788917234.207981:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788917234.207985:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140824448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917234.207994:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140824576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917234.208027:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140824448:12345-0@lo:400:kworker.0 Request processed in 51us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917234.208034:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788917234.208039:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140824576:12345-0@lo:400:kworker.0 Request processed in 49us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917234.208047:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788917234.208095:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917234.208101:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140824704:0@lo:400:kworker.0 00000100:00100000:0.0:1788917234.208111:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140824576:0@lo:400:kworker.0 00000100:00100000:3.0:1788917234.208190:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01a83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140824448:0@lo:400:kworker.0 00000100:00100000:3.0:1788917234.208233:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140824832:0@lo:400:kworker.0 00000100:00100000:1.0:1788917234.208262:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140824960 00000100:00100000:1.0:1788917234.208269:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140824960 00000100:00100000:1.0:1788917234.208330:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788917234.208340:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140824960:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788917234.208383:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917234.208391:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140824960:12345-0@lo:400:kworker.0 Request processed in 52us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917234.208400:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788917234.208414:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140824960:0@lo:400:kworker.0 00000100:00100000:3.0:1788917234.208765:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140825088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917234.208787:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917234.208819:0:20500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140825088 00000100:00100000:2.0:1788917234.208825:0:20500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140825088 00000100:00100000:2.0:1788917234.208859:0:20500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788917234.208867:0:20500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140825088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788917234.209003:0:20500:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917234.209051:0:20500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140825088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 185us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917234.209057:0:20500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788917234.209130:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140825088:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788917234.299931:0:22042:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917234.299938:0:22042:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917234.300394:0:22042:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917234.300401:0:22042:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917234.591986:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917235.295468:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917235.295479:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917235.295923:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917235.295931:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917235.615237:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917235.653463:0:22093:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917235.653472:0:22093:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917235.654000:0:22093:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917235.654009:0:22093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917236.618379:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917236.618420:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917236.618455:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917236.618476:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113583872 00000100:00100000:2.0:1788917236.618487:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113583872 00000100:00100000:1.0:1788917236.618494:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917236.618554:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 180 00000100:00100000:3.0:1788917236.618557:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113584000 00000100:00100000:3.0:1788917236.618563:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113584000 00000100:00100000:2.0:1788917236.618567:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113583872:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917236.618606:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113584256 00000100:00100000:3.0:1788917236.618611:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113584256 00000100:00100000:2.0:1788917236.618636:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113583872:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 72us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917236.618642:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 173 00000100:00100000:2.0:1788917236.618646:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 180 00000100:00100000:3.0:1788917236.618654:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113584000:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:2.0:1788917236.618689:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917236.618695:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113584000:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 44us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917236.618703:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 173 00000100:00100000:2.0:1788917236.618719:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 174 00000100:00100000:2.0:1788917236.618726:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113584256:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917236.618752:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113584256:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 28us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917236.618757:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 174 00000100:00100000:0.0:1788917236.618819:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113584128 00000100:00100000:0.0:1788917236.618822:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113584128 00000100:00100000:0.0:1788917236.618863:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 103 00000100:00100000:0.0:1788917236.618873:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113584128:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917236.618924:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113584128:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 53us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917236.618931:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 103 00000100:00080000:2.0:1788917236.618986:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788917236.639327:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917237.056093:0:22144:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917237.056102:0:22144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917237.056670:0:22144:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917237.056677:0:22144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917237.279365:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788917237.279569:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140825216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788917237.279627:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917237.279819:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140825216 00000100:00100000:0.0:1788917237.279827:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140825216 00000100:00100000:0.0:1788917237.279887:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788917237.279896:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140825216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788917237.279931:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917237.279978:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140825216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917237.279986:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788917237.279994:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788917237.280022:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140825216:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788917237.665843:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917238.499136:0:22195:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917238.499169:0:22195:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917238.499720:0:22195:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917238.499730:0:22195:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917238.687365:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917239.327351:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140825472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917239.327393:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3bdd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140825728:0@lo:400:kworker.0 00000100:00100000:3.0:1788917239.327425:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917239.327440:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917239.327487:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3bdd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140825984:0@lo:400:kworker.0 00000100:00100000:3.0:1788917239.327512:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917239.327525:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140825600:0@lo:400:kworker.0 00000100:00100000:3.0:1788917239.327535:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788917239.327556:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01cc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140825344:0@lo:400:kworker.0 00000100:00100000:2.0:1788917239.327563:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917239.327591:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3bdd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140826112:0@lo:400:kworker.0 00000100:00100000:3.0:1788917239.327600:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917239.327630:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917239.327638:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3bdd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140825856:0@lo:400:kworker.0 00000100:00100000:3.0:1788917239.327670:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917239.327675:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140825728 00000100:00100000:2.0:1788917239.327683:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140825728 00000100:00100000:3.0:1788917239.327705:0:20500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140825472 00000100:00100000:3.0:1788917239.327711:0:20500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140825472 00000100:00100000:2.0:1788917239.327739:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140825600 00000100:00100000:2.0:1788917239.327744:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140825600 00000100:00100000:3.0:1788917239.327769:0:20500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788917239.327778:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788917239.327782:0:20500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140825472:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788917239.327791:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140825728:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788917239.327818:0:20500:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917239.327840:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140825728:12345-0@lo:400:kworker.0 Request processed in 53us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917239.327848:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788917239.327866:0:20500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140825472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917239.327873:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788917239.327877:0:20500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788917239.327885:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140825600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917239.327918:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140825984 00000100:00100000:3.0:1788917239.327923:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140825984 00000100:00100000:2.0:1788917239.327929:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140825600:12345-0@lo:400:kworker.0 Request processed in 46us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917239.327942:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140826112 00000100:00100000:2.0:1788917239.327945:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788917239.327949:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140826112 00000100:00100000:3.0:1788917239.327956:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140825856 00000100:00100000:3.0:1788917239.327962:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140825856 00000100:00080000:2.0:1788917239.327971:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788917239.327978:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788917239.327981:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788917239.327991:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788917239.328004:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788917239.328005:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140825984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917239.328018:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140826112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917239.328043:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01ccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140825984:12345-0@lo:400:kworker.0 Request processed in 44us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917239.328065:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875815140826112:12345-0@lo:400:kworker.0 Request processed in 51us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917239.329643:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3bdd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140825728:0@lo:400:kworker.0 00000100:00100000:1.0:1788917239.329675:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140825344 00000100:00100000:1.0:1788917239.329679:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140825344 00000100:00100000:1.0:1788917239.329702:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788917239.329707:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140825344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917239.329738:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140825344:12345-0@lo:400:kworker.0 Request processed in 31us (2141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917239.329742:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788917239.329797:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788917239.329804:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140825856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917239.329828:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875815140825856:12345-0@lo:400:kworker.0 Request processed in 26us (2160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917239.329832:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788917239.329865:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140825600:0@lo:400:kworker.0 00000100:00100000:2.0:1788917239.329872:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3bdd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875815140826112:0@lo:400:kworker.0 00000100:00100000:3.0:1788917239.329878:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788917239.329899:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01cc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140825344:0@lo:400:kworker.0 00000100:00100000:2.0:1788917239.329907:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3bdd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875815140825856:0@lo:400:kworker.0 00000100:00100000:2.0:1788917239.329914:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3bdd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140825984:0@lo:400:kworker.0 00000100:00100000:2.0:1788917239.329927:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140825472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917239.330860:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00010000:00010000:1.0:1788917239.711377:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917239.948702:0:22246:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917239.948712:0:22246:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917239.949342:0:22246:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917239.949349:0:22246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917240.735393:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788917241.418490:0:22298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788917241.418502:0:22298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788917241.419283:0:22298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:2.0:1788917241.419294:0:22298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917241.740991:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917241.741040:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917241.741069:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917241.741100:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917241.741249:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113584640 00000100:00100000:0.0:1788917241.741259:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113584640 00000100:00100000:0.0:1788917241.741326:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 106 00000100:00100000:0.0:1788917241.741337:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113584640:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917241.741406:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113584640:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 71us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917241.741413:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 106 00000100:00080000:1.0:1788917241.741745:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917241.741827:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113584512 00000100:00100000:2.0:1788917241.741831:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113584512 00000100:00100000:2.0:1788917241.741879:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113584768 00000100:00100000:2.0:1788917241.741883:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113584768 00000100:00100000:2.0:1788917241.741905:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 178 00000100:00100000:2.0:1788917241.741922:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113584512:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917241.741960:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113584512:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 40us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917241.741968:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 178 00000100:00100000:2.0:1788917241.741987:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 179 00000100:00100000:2.0:1788917241.741994:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113584768:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917241.742017:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113584768:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917241.742024:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 179 00000100:00080000:1.0:1788917241.742226:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917241.742400:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113584384 00000100:00100000:3.0:1788917241.742405:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113584384 00000100:00100000:3.0:1788917241.742444:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 182 00000100:00100000:3.0:1788917241.742452:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113584384:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917241.742484:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113584384:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 32us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917241.742490:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 182 00010000:00010000:0.0:1788917241.759326:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917242.399916:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140826240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917242.400004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917242.400066:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140826240 00000100:00100000:0.0:1788917242.400074:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140826240 00000100:00080000:1.0:1788917242.400112:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917242.400127:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788917242.400137:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140826240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788917242.400217:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917242.400262:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140826240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917242.400270:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788917242.400516:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140826240:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788917242.784291:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917242.808582:0:22349:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917242.808590:0:22349:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917242.809125:0:22349:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917242.809133:0:22349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917243.812287:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917244.308578:0:22400:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917244.308586:0:22400:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917244.309075:0:22400:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917244.309084:0:22400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788917244.447387:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140826368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917244.447470:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917244.447553:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140826368 00000100:00100000:0.0:1788917244.447561:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140826368 00000100:00100000:0.0:1788917244.447626:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788917244.447636:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140826368:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788917244.447672:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1788917244.447678:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917244.447734:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140826368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917244.447742:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788917244.447790:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140826368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917244.447991:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140826624:0@lo:400:kworker.0 00000100:00100000:1.0:1788917244.447999:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140826496:0@lo:400:kworker.0 00000100:00100000:1.0:1788917244.448041:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917244.448052:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917244.448072:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140827008:0@lo:400:kworker.0 00000100:00100000:3.0:1788917244.448083:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788917244.448092:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140826752:0@lo:400:kworker.0 00000100:00100000:1.0:1788917244.448113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917244.448136:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140826624 00000100:00100000:3.0:1788917244.448141:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140826624 00000100:00100000:1.0:1788917244.448169:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788917244.448177:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140826880:0@lo:400:kworker.0 00000100:00100000:1.0:1788917244.448215:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917244.448226:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788917244.448235:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d010f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140826624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917244.448265:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140827008 00000100:00100000:1.0:1788917244.448270:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140827008 00000100:00100000:3.0:1788917244.448279:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d010f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140826624:12345-0@lo:400:kworker.0 Request processed in 45us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917244.448288:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788917244.448308:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140826880 00000100:00080000:3.0:1788917244.448311:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917244.448313:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140826880 00000100:00080000:3.0:1788917244.448317:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917244.448348:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788917244.448349:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917244.448360:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140827008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917244.448386:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140826624:0@lo:400:kworker.0 00000100:00100000:1.0:1788917244.448405:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140827008:12345-0@lo:400:kworker.0 Request processed in 47us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917244.448410:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788917244.448417:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140826752 00000100:00100000:3.0:1788917244.448423:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140826752 00000100:00100000:1.0:1788917244.448432:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788917244.448439:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140826880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917244.448452:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788917244.448463:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e09918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140826752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917244.448466:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875815140826880:12345-0@lo:400:kworker.0 Request processed in 28us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917244.448475:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788917244.448497:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875815140826880:0@lo:400:kworker.0 00000100:00100000:1.0:1788917244.448505:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140827008:0@lo:400:kworker.0 00000100:00100000:3.0:1788917244.448522:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e09918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140826752:12345-0@lo:400:kworker.0 Request processed in 60us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917244.448531:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:3.0:1788917244.448549:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917244.448567:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140826752:0@lo:400:kworker.0 00000100:00100000:2.0:1788917244.448636:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140826496 00000100:00100000:2.0:1788917244.448641:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140826496 00000100:00100000:2.0:1788917244.448672:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788917244.448678:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140826496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917244.448724:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3307:x1875815140826496:12345-0@lo:400:kworker.0 Request processed in 47us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917244.448731:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788917244.448802:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3307:1875815140826496:0@lo:400:kworker.0 00010000:00010000:0.0:1788917244.831272:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917245.535366:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917245.535376:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917245.535876:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917245.535891:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:3.0:1788917245.719005:0:22451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917245.719016:0:22451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917245.719659:0:22451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917245.719680:0:22451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917245.855343:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917246.855989:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917246.856040:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917246.856072:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917246.856102:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113584896 00000100:00100000:0.0:1788917246.856113:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113584896 00000100:00100000:2.0:1788917246.856119:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113585024 00000100:00100000:2.0:1788917246.856126:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113585024 00000100:00100000:1.0:1788917246.856131:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917246.856213:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 184 00000100:00100000:0.0:1788917246.856225:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113584896:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917246.856231:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113585152 00000100:00100000:1.0:1788917246.856237:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113585152 00000100:00100000:1.0:1788917246.856277:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 108 00000100:00100000:2.0:1788917246.856278:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113585280 00000100:00100000:2.0:1788917246.856283:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113585280 00000100:00100000:1.0:1788917246.856288:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113585152:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917246.856298:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113584896:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 74us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917246.856307:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 184 00000100:00100000:2.0:1788917246.856320:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 183 00000100:00100000:1.0:1788917246.856326:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113585152:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 40us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917246.856335:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 108 00000100:00100000:2.0:1788917246.856344:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113585024:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:1.0:1788917246.856357:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788917246.856369:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917246.856394:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113585024:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 54us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917246.856402:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 183 00000100:00100000:1.0:1788917246.856590:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 184 00000100:00100000:1.0:1788917246.856599:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3bdd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113585280:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917246.856634:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3bdd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113585280:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 37us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917246.856641:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 184 00010000:00010000:3.0:1788917246.879464:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917247.078798:0:22502:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917247.078808:0:22502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917247.079462:0:22502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917247.079473:0:22502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917247.519403:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788917247.519431:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140827136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917247.519504:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917247.519548:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140827136 00000100:00100000:0.0:1788917247.519557:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140827136 00000100:00080000:1.0:1788917247.519594:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917247.519617:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788917247.519628:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140827136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788917247.519667:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917247.519797:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140827136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 171us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917247.519806:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788917247.519955:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140827136:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788917247.903322:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917248.471893:0:22554:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917248.471905:0:22554:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917248.472409:0:22554:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917248.472418:0:22554:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917248.928260:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917249.567324:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0991b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140827264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917249.567404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917249.567456:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140827392:0@lo:400:kworker.0 00000100:00100000:3.0:1788917249.567471:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140827776:0@lo:400:kworker.0 00000100:00100000:1.0:1788917249.567503:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917249.567528:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917249.567541:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140827904:0@lo:400:kworker.0 00000100:00100000:3.0:1788917249.567558:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788917249.567567:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140827648:0@lo:400:kworker.0 00000100:00100000:1.0:1788917249.567575:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917249.567603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917249.567606:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788917249.567614:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140827520:0@lo:400:kworker.0 00000100:00100000:3.0:1788917249.567648:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140827264 00000100:00100000:3.0:1788917249.567657:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140827264 00000100:00100000:3.0:1788917249.567721:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788917249.567733:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e09919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140827264:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917249.567773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788917249.567789:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917249.567798:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2d0b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140828032:0@lo:400:kworker.0 00000100:00100000:1.0:1788917249.567825:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917249.567856:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e09919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140827264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917249.567865:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788917249.567868:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140827776 00000100:00100000:1.0:1788917249.567874:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140827776 00000100:00100000:3.0:1788917249.567898:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140827392 00000100:00100000:3.0:1788917249.567904:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140827392 00000100:00100000:1.0:1788917249.567915:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140827904 00000100:00100000:1.0:1788917249.567920:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140827904 00000100:00100000:3.0:1788917249.567937:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788917249.567948:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140827392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917249.567950:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140828032 00000100:00100000:1.0:1788917249.567961:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140828032 00000100:00100000:1.0:1788917249.567986:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788917249.567993:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140827392:12345-0@lo:400:kworker.0 Request processed in 47us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917249.567996:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0991b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140827776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917249.568006:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788917249.568059:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0991b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140827776:12345-0@lo:400:kworker.0 Request processed in 65us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917249.568060:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788917249.568072:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140827904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917249.568075:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788917249.568101:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788917249.568110:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140828032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917249.568117:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140827904:12345-0@lo:400:kworker.0 Request processed in 47us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917249.568132:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788917249.568185:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140828032:12345-0@lo:400:kworker.0 Request processed in 76us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917249.568192:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140827648 00000100:00100000:1.0:1788917249.568196:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788917249.568198:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140827648 00000100:00100000:3.0:1788917249.568226:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140827520 00000100:00100000:3.0:1788917249.568228:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140827520 00000100:00100000:3.0:1788917249.568256:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788917249.568263:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788917249.568265:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0991a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140827648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917249.568276:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140827520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917249.568311:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0991a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140827648:12345-0@lo:400:kworker.0 Request processed in 47us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917249.568321:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788917249.568326:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140827520:12345-0@lo:400:kworker.0 Request processed in 52us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917249.568334:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1788917249.568365:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788917249.568371:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788917249.568374:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788917249.568378:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140827520:0@lo:400:kworker.0 00000100:00100000:3.0:1788917249.568397:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140828032:0@lo:400:kworker.0 00000100:00100000:1.0:1788917249.568453:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140827648:0@lo:400:kworker.0 00000100:00100000:1.0:1788917249.568464:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140827776:0@lo:400:kworker.0 00000100:00100000:3.0:1788917249.568482:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140827392:0@lo:400:kworker.0 00000100:00100000:1.0:1788917249.568496:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0991b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140827264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917249.568543:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2d0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140827904:0@lo:400:kworker.0 00000040:00080000:1.0:1788917249.884895:0:22605:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917249.884903:0:22605:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917249.886532:0:22605:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917249.886552:0:22605:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917249.952629:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788917250.975595:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917251.260036:0:22656:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917251.260046:0:22656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917251.260504:0:22656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917251.260513:0:22656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917251.975387:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917251.975430:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917251.975451:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113585408 00000100:00100000:1.0:1788917251.975462:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113585408 00000100:00100000:3.0:1788917251.975471:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917251.975480:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113585664 00000100:00100000:0.0:1788917251.975486:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113585664 00000100:00100000:3.0:1788917251.975521:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917251.975549:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 111 00000100:00100000:3.0:1788917251.975557:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 186 00000100:00100000:0.0:1788917251.975561:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e09919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113585664:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917251.975565:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113585536 00000100:00100000:2.0:1788917251.975572:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113585536 00000100:00100000:3.0:1788917251.975573:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113585408:12345-192.168.202.40@tcp:400:kworker.0 00000100:00080000:1.0:1788917251.975586:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788917251.975593:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917251.975607:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113585792 00000100:00100000:1.0:1788917251.975612:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113585792 00000100:00100000:2.0:1788917251.975638:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 188 00000100:00100000:0.0:1788917251.975660:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e09919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113585664:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 88us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917251.975668:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e09918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2374:x1875815113585536:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917251.975671:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 111 00000100:00100000:1.0:1788917251.975727:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 189 00000100:00100000:1.0:1788917251.975735:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0991b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5ef94afb-c48b-479f-853f-434eacee288c+6:2374:x1875815113585792:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917251.975748:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113585408:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 179us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917251.975757:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 186 00000100:00100000:1.0:1788917251.975772:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0991b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5ef94afb-c48b-479f-853f-434eacee288c+6:2374:x1875815113585792:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 36us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917251.975781:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 189 00000100:00080000:1.0:1788917251.975813:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917251.975819:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e09918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2374:x1875815113585536:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 170us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917251.975828:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 188 00010000:00010000:1.0:1788917251.999337:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917252.641603:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e37135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140828160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788917252.641678:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917252.641723:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140828160 00000100:00100000:0.0:1788917252.641730:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140828160 00000100:00080000:2.0:1788917252.641782:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917252.641813:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788917252.641834:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0991aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140828160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788917252.641881:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917252.641933:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0991aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140828160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917252.641939:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788917252.641990:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e37135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140828160:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788917252.652362:0:22707:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917252.652371:0:22707:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917252.652797:0:22707:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917252.652805:0:22707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917253.023491:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917254.043801:0:22758:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917254.043810:0:22758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917254.044489:0:22758:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917254.044499:0:22758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788917254.049274:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788917254.687350:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788917254.687365:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788917254.687381:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e09918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140828544:0@lo:400:kworker.0 00000100:00100000:1.0:1788917254.687381:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140828416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917254.687440:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e09919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3305:1875815140828288:0@lo:400:kworker.0 00000100:00100000:2.0:1788917254.687466:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917254.687466:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917254.687490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917254.687546:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e09919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140829056:0@lo:400:kworker.0 00000100:00100000:2.0:1788917254.687551:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e09918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140828928:0@lo:400:kworker.0 00000100:00100000:3.0:1788917254.687552:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0991ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140828800:0@lo:400:kworker.0 00000100:00100000:1.0:1788917254.687584:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917254.687626:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140828544 00000100:00100000:3.0:1788917254.687635:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140828544 00000100:00100000:2.0:1788917254.687638:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140829056 00000100:00100000:2.0:1788917254.687644:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140829056 00000100:00100000:1.0:1788917254.687652:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917254.687678:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788917254.687685:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e09918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140828672:0@lo:400:kworker.0 00000100:00100000:0.0:1788917254.687688:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140828288 00000100:00100000:0.0:1788917254.687693:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140828288 00000100:00100000:2.0:1788917254.687708:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140828800 00000100:00100000:3.0:1788917254.687715:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788917254.687715:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140828800 00000100:00100000:1.0:1788917254.687715:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917254.687728:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788917254.687733:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140828544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917254.687741:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3305:x1875815140828288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917254.687751:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788917254.687764:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140829056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917254.687764:0:14266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788917254.687778:0:14266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140828800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917254.687800:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140828544:12345-0@lo:400:kworker.0 Request processed in 72us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917254.687809:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788917254.687814:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3305:x1875815140828288:12345-0@lo:400:kworker.0 Request processed in 75us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917254.687820:0:14266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140828800:12345-0@lo:400:kworker.0 Request processed in 46us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917254.687823:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788917254.687826:0:14266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788917254.687831:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140829056:12345-0@lo:400:kworker.0 Request processed in 71us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917254.687839:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788917254.687842:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140828672 00000100:00100000:3.0:1788917254.687847:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140828672 00000100:00100000:2.0:1788917254.687871:0:20500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140828416 00000100:00100000:2.0:1788917254.687876:0:20500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140828416 00000100:00100000:3.0:1788917254.687884:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788917254.687886:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e09919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3305:1875815140828288:0@lo:400:kworker.0 00000100:00100000:3.0:1788917254.687896:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140828672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917254.687907:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0991ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140828800:0@lo:400:kworker.0 00000100:00100000:2.0:1788917254.687913:0:20500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788917254.687923:0:20500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140828416:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788917254.687937:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140828672:12345-0@lo:400:kworker.0 Request processed in 44us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917254.687945:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788917254.687950:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e09918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140828672:0@lo:400:kworker.0 00002000:00000024:2.0:1788917254.687955:0:20500:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788917254.687967:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788917254.687974:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917254.687980:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e09919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140829056:0@lo:400:kworker.0 00000100:00080000:3.0:1788917254.687985:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917254.688004:0:20500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140828416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917254.688012:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140828416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788917254.688027:0:20500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788917254.688041:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917254.688123:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e09918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140828544:0@lo:400:kworker.0 00000100:00100000:2.0:1788917254.688284:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140828928 00000100:00100000:2.0:1788917254.688289:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140828928 00000100:00100000:2.0:1788917254.688334:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788917254.688341:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e09919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140828928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917254.688396:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e09919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875815140828928:12345-0@lo:400:kworker.0 Request processed in 54us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917254.688402:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788917254.688479:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e09918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875815140828928:0@lo:400:kworker.0 00000100:00080000:3.0:1788917254.689582:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788917255.071341:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917255.398860:0:22810:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917255.398871:0:22810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917255.399332:0:22810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917255.399341:0:22810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:1.0:1788917255.776304:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917255.776314:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917255.776859:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917255.776870:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917256.095279:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917256.817861:0:22861:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917256.817868:0:22861:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917256.819760:0:22861:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917256.819768:0:22861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788917257.097676:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917257.097727:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917257.097748:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113586048 00000100:00100000:1.0:1788917257.097761:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113586048 00000100:00100000:0.0:1788917257.097810:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917257.097842:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113586304 00000100:00100000:0.0:1788917257.097845:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917257.097848:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113586304 00000100:00100000:1.0:1788917257.097877:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 193 00000100:00100000:1.0:1788917257.097887:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e37135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2372:x1875815113586048:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917257.097897:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 194 00000100:00100000:0.0:1788917257.097910:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2372:x1875815113586304:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917257.097982:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2372:x1875815113586304:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 76us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917257.097995:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 194 00000100:00080000:2.0:1788917257.098031:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917257.098059:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113586176 00000100:00100000:0.0:1788917257.098076:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113586176 00000100:00100000:0.0:1788917257.098117:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 114 00000100:00100000:0.0:1788917257.098124:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2371:x1875815113586176:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917257.098184:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2371:x1875815113586176:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 61us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917257.098191:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 114 00000100:00080000:2.0:1788917257.098229:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917257.098358:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e37135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2372:x1875815113586048:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 471us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917257.098365:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 193 00000100:00100000:3.0:1788917257.098399:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113585920 00000100:00100000:3.0:1788917257.098404:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113585920 00000100:00100000:3.0:1788917257.098453:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 188 00000100:00100000:3.0:1788917257.098458:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2371:x1875815113585920:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917257.098479:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2371:x1875815113585920:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 21us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917257.098484:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 188 00010000:00010000:3.0:1788917257.119336:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917257.759572:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140829184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788917257.759643:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917257.761124:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140829184 00000100:00100000:0.0:1788917257.761133:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140829184 00000100:00100000:0.0:1788917257.761264:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788917257.761273:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e09918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140829184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788917257.761321:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917257.761383:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e09918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140829184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917257.761391:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788917257.761435:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140829184:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788917257.763474:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788917258.143310:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917258.167727:0:22912:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917258.167736:0:22912:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917258.168339:0:22912:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917258.168348:0:22912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917259.168327:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917259.601234:0:22963:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917259.601247:0:22963:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917259.601704:0:22963:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917259.601713:0:22963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917259.807322:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0991bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3305:1875815140829312:0@lo:400:kworker.0 00000100:00100000:0.0:1788917259.807348:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0991a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140829440:0@lo:400:kworker.0 00000100:00100000:3.0:1788917259.807398:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e09919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140829696:0@lo:400:kworker.0 00000100:00100000:1.0:1788917259.807404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917259.807444:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917259.807465:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e09918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875815140829824:0@lo:400:kworker.0 00000100:00100000:3.0:1788917259.807489:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e09918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140829568:0@lo:400:kworker.0 00000100:00100000:1.0:1788917259.807497:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917259.807522:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917259.807542:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140829312 00000100:00100000:3.0:1788917259.807543:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140829696 00000100:00100000:3.0:1788917259.807551:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140829696 00000100:00100000:1.0:1788917259.807551:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140829312 00000100:00100000:0.0:1788917259.807562:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0991ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140829952:0@lo:400:kworker.0 00000100:00100000:0.0:1788917259.807592:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917259.807606:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140829824 00000100:00100000:3.0:1788917259.807610:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140829824 00000100:00100000:1.0:1788917259.807611:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788917259.807623:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3305:x1875815140829312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917259.807627:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140829952 00000100:00100000:0.0:1788917259.807632:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140829952 00000100:00100000:3.0:1788917259.807648:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788917259.807659:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e09919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140829696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917259.807677:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3305:x1875815140829312:12345-0@lo:400:kworker.0 Request processed in 55us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917259.807687:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788917259.807697:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788917259.807709:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875815140829824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917259.807734:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e09919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140829696:12345-0@lo:400:kworker.0 Request processed in 75us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917259.807743:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788917259.807752:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0991bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3305:1875815140829312:0@lo:400:kworker.0 00000100:00100000:0.0:1788917259.807760:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875815140829824:12345-0@lo:400:kworker.0 Request processed in 55us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917259.807768:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788917259.807776:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788917259.807782:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140829952:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788917259.807793:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917259.807802:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140829440 00000100:00100000:1.0:1788917259.807803:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e09918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875815140829824:0@lo:400:kworker.0 00000100:00100000:0.0:1788917259.807808:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140829440 00000100:00100000:3.0:1788917259.807839:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140829952:12345-0@lo:400:kworker.0 Request processed in 59us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917259.807856:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788917259.807858:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788917259.807865:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e09919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140829696:0@lo:400:kworker.0 00000100:00100000:0.0:1788917259.807871:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140829440:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788917259.807906:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917259.807913:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140829440:12345-0@lo:400:kworker.0 Request processed in 44us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917259.807920:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788917259.807962:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0991ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140829952:0@lo:400:kworker.0 00000100:00100000:0.0:1788917259.807973:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0991a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140829440:0@lo:400:kworker.0 00000100:00100000:0.0:1788917259.807989:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788917259.807996:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140830080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917259.808027:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917259.808117:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917259.808179:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140829568 00000100:00100000:0.0:1788917259.808184:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140829568 00000100:00100000:0.0:1788917259.808226:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788917259.808234:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2d0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140829568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917259.808279:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2d0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140829568:12345-0@lo:400:kworker.0 Request processed in 47us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917259.808287:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788917259.808314:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e09918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140829568:0@lo:400:kworker.0 00000100:00100000:2.0:1788917259.808458:0:20500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140830080 00000100:00100000:2.0:1788917259.808463:0:20500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140830080 00000100:00100000:2.0:1788917259.808497:0:20500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788917259.808507:0:20500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140830080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788917259.808535:0:20500:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788917259.808581:0:20500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140830080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917259.808588:0:20500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788917259.808592:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140830080:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788917259.808691:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788917260.191963:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917261.016528:0:23014:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917261.016545:0:23014:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917261.017085:0:23014:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917261.017093:0:23014:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917261.215599:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788917262.216692:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917262.216750:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917262.216804:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917262.216814:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113586432 00000100:00100000:3.0:1788917262.216829:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113586432 00000100:00100000:0.0:1788917262.216849:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917262.216893:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 190 00000100:00100000:3.0:1788917262.216905:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2371:x1875815113586432:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917262.216999:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113586688 00000100:00100000:1.0:1788917262.217004:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113586688 00000100:00100000:1.0:1788917262.217081:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 117 00000100:00100000:3.0:1788917262.217083:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2371:x1875815113586432:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 177us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917262.217095:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2371:x1875815113586688:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917262.217099:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 190 00000100:00100000:2.0:1788917262.217116:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113586560 00000100:00100000:2.0:1788917262.217122:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113586560 00000100:00100000:2.0:1788917262.217203:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113586816 00000100:00100000:2.0:1788917262.217206:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113586816 00000100:00080000:3.0:1788917262.217222:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788917262.217229:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917262.217240:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 198 00000100:00100000:2.0:1788917262.217249:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2371:x1875815113586560:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917262.217263:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 199 00000100:00100000:3.0:1788917262.217276:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e06f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2371:x1875815113586816:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917262.217321:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5ef94afb-c48b-479f-853f-434eacee288c+6:2371:x1875815113586816:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 49us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917262.217325:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2371:x1875815113586560:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 74us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917262.217334:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 199 00000100:00100000:2.0:1788917262.217353:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 198 00000100:00100000:1.0:1788917262.217502:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e06f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2371:x1875815113586688:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 411us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917262.217509:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 117 00010000:00010000:0.0:1788917262.239277:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917262.418832:0:23066:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917262.418846:0:23066:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917262.419473:0:23066:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917262.419482:0:23066:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917262.879388:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788917262.879424:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140830208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788917262.879520:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917262.879679:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140830208 00000100:00100000:0.0:1788917262.879689:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140830208 00000100:00100000:0.0:1788917262.879766:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788917262.879776:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140830208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788917262.879822:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917262.879899:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140830208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917262.879906:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788917262.879959:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140830208:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788917262.880105:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788917263.263397:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917263.767266:0:23117:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917263.767280:0:23117:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917263.767813:0:23117:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917263.767824:0:23117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788917264.287343:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788917264.927353:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788917264.927380:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140830336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788917264.927453:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917264.927674:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140830336 00000100:00100000:3.0:1788917264.927683:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140830336 00000100:00100000:3.0:1788917264.927752:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788917264.927762:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140830336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788917264.927797:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788917264.927844:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875815140830336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917264.927852:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788917264.927902:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875815140830336:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788917264.928090:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788917264.930106:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a7d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140830464:0@lo:400:kworker.0 00000100:00100000:1.0:1788917264.930118:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140830592:0@lo:400:kworker.0 00000100:00100000:2.0:1788917264.930167:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917264.930172:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788917264.930205:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a7d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140830976:0@lo:400:kworker.0 00000100:00100000:3.0:1788917264.930212:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a7d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140830720:0@lo:400:kworker.0 00000100:00100000:1.0:1788917264.930214:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140830464 00000100:00100000:1.0:1788917264.930221:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140830464 00000100:00100000:2.0:1788917264.930233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917264.930258:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788917264.930259:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917264.930269:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3fcaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140830464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917264.930272:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140830976 00000100:00100000:2.0:1788917264.930276:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140830976 00000100:00100000:3.0:1788917264.930289:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788917264.930298:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0a7d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140830848:0@lo:400:kworker.0 00000100:00100000:1.0:1788917264.930316:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3fcaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3306:x1875815140830464:12345-0@lo:400:kworker.0 Request processed in 49us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917264.930327:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917264.930340:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788917264.930362:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140830720 00000100:00100000:3.0:1788917264.930367:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140830720 00000100:00100000:2.0:1788917264.930375:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140830848 00000100:00100000:1.0:1788917264.930376:0:16665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140830592 00000100:00100000:2.0:1788917264.930381:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140830848 00000100:00100000:1.0:1788917264.930381:0:16665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140830592 00000100:00100000:3.0:1788917264.930401:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788917264.930410:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788917264.930417:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140830976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917264.930422:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140830592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917264.930455:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140830976:12345-0@lo:400:kworker.0 Request processed in 47us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917264.930463:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788917264.930469:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788917264.930473:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0991b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140830720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917264.930473:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140830592:12345-0@lo:400:kworker.0 Request processed in 55us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917264.930481:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788917264.930490:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788917264.930498:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e09918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140830848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917264.930515:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0991b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140830720:12345-0@lo:400:kworker.0 Request processed in 44us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917264.930517:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140830592:0@lo:400:kworker.0 00000100:00100000:2.0:1788917264.930523:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788917264.930527:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e09918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140830848:12345-0@lo:400:kworker.0 Request processed in 30us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917264.930532:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:2.0:1788917264.930545:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788917264.930548:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a7d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140830976:0@lo:400:kworker.0 00000100:00080000:2.0:1788917264.930551:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917264.930557:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a7d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3306:1875815140830464:0@lo:400:kworker.0 00000100:00100000:3.0:1788917264.930585:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a7d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140830848:0@lo:400:kworker.0 00000100:00100000:3.0:1788917264.930608:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0a7d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140830720:0@lo:400:kworker.0 00000040:00080000:0.0:1788917265.162957:0:23168:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917265.162969:0:23168:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917265.163672:0:23168:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917265.163679:0:23168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917265.311273:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917266.015463:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917266.015474:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917266.016014:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917266.016026:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788917266.335399:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917266.616483:0:23219:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917266.616494:0:23219:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917266.619917:0:23219:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917266.619935:0:23219:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788917267.335454:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917267.335714:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113586944 00000100:00100000:3.0:1788917267.335725:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113586944 00000100:00100000:3.0:1788917267.335870:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 192 00000100:00100000:3.0:1788917267.335881:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113586944:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917267.335959:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f284850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113586944:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 80us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917267.335967:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 192 00000100:00100000:1.0:1788917267.340089:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1788917267.340282:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113587072 00000100:00100000:2.0:1788917267.340292:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113587072 00000100:00100000:2.0:1788917267.340424:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 203 00000100:00100000:2.0:1788917267.340436:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2374:x1875815113587072:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917267.340536:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2374:x1875815113587072:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 102us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917267.340544:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 203 00000100:00080000:0.0:1788917267.341335:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788917267.343125:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917267.343234:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917267.343319:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113587200 00000100:00100000:0.0:1788917267.343332:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113587200 00000100:00080000:2.0:1788917267.343462:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917267.343503:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 119 00000100:00100000:0.0:1788917267.343514:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2373:x1875815113587200:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1788917267.343596:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2373:x1875815113587200:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 83us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917267.343604:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 119 00000100:00100000:3.0:1788917267.343758:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113587328 00000100:00100000:3.0:1788917267.343763:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113587328 00000100:00100000:3.0:1788917267.343809:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 204 00000100:00100000:3.0:1788917267.343825:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113587328:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917267.343911:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113587328:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 94us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917267.343919:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 204 00000100:00080000:2.0:1788917267.344047:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788917267.360054:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917267.999315:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788917267.999338:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140831104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788917267.999408:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917267.999497:0:20500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140831104 00000100:00100000:0.0:1788917267.999504:0:20500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140831104 00000100:00100000:0.0:1788917267.999564:0:20500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788917267.999573:0:20500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0991a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140831104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788917267.999611:0:20500:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917267.999655:0:20500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0991a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140831104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917267.999662:0:20500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788917267.999709:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788917267.999758:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140831104:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788917268.044661:0:23270:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917268.044670:0:23270:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917268.045325:0:23270:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917268.045332:0:23270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917268.383374:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788917269.407291:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788917269.422624:0:23321:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788917269.422633:0:23321:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788917269.423206:0:23321:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:3.0:1788917269.423221:0:23321:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788917270.049126:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140831616:0@lo:400:kworker.0 00000100:00100000:2.0:1788917270.049131:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140831488:0@lo:400:kworker.0 00000100:00100000:1.0:1788917270.049202:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e06f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140831232:0@lo:400:kworker.0 00000100:00100000:3.0:1788917270.049217:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917270.049239:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140831360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917270.049248:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917270.049292:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140831744:0@lo:400:kworker.0 00000100:00100000:3.0:1788917270.049294:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788917270.049302:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140832000:0@lo:400:kworker.0 00000100:00100000:0.0:1788917270.049309:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917270.049324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917270.049342:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e2c990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875815140831872:0@lo:400:kworker.0 00000100:00100000:3.0:1788917270.049352:0:14904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140831360 00000100:00100000:3.0:1788917270.049359:0:14904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140831360 00000100:00100000:1.0:1788917270.049380:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140831616 00000100:00100000:1.0:1788917270.049385:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140831616 00000100:00100000:0.0:1788917270.049389:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917270.049416:0:14904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788917270.049427:0:14904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140831360:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788917270.049432:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788917270.049442:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0991ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140831616:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788917270.049465:0:14904:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788917270.049486:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0991ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875815140831616:12345-0@lo:400:kworker.0 Request processed in 45us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917270.049496:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788917270.049508:0:14904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a555180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875815140831360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917270.049516:0:14904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788917270.049520:0:14259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140831232 00000100:00100000:1.0:1788917270.049525:0:14259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140831232 00000100:00100000:1.0:1788917270.049557:0:14259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788917270.049564:0:14259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140831232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917270.049595:0:14259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140831232:12345-0@lo:400:kworker.0 Request processed in 32us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917270.049602:0:14259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788917270.049641:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e06f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140831232:0@lo:400:kworker.0 00000100:00080000:1.0:1788917270.049680:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788917270.050969:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140831360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917270.051008:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140831744 00000100:00100000:0.0:1788917270.051012:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140831744 00000100:00100000:0.0:1788917270.051044:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140831872 00000100:00100000:0.0:1788917270.051047:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140831872 00000100:00100000:1.0:1788917270.051056:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917270.051079:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140832000 00000100:00100000:0.0:1788917270.051083:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140832000 00000100:00100000:1.0:1788917270.051093:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140831616:0@lo:400:kworker.0 00000100:00100000:3.0:1788917270.051098:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788917270.051111:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140831744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917270.051128:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788917270.051136:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788917270.051141:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875815140831872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917270.051186:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140832000:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788917270.051215:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917270.051380:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875815140831744:12345-0@lo:400:kworker.0 Request processed in 271us (2055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917270.051383:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875815140831872:12345-0@lo:400:kworker.0 Request processed in 246us (1996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917270.051397:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788917270.051398:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917270.051401:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875815140832000:12345-0@lo:400:kworker.0 Request processed in 255us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917270.051408:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788917270.051417:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788917270.051450:0:14903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140831488 00000100:00100000:2.0:1788917270.051456:0:14903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140831488 00000100:00100000:3.0:1788917270.051457:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875815140831744:0@lo:400:kworker.0 00000100:00100000:0.0:1788917270.051459:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c990a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875815140831872:0@lo:400:kworker.0 00000100:00100000:1.0:1788917270.051466:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875815140832000:0@lo:400:kworker.0 00000100:00080000:0.0:1788917270.051496:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917270.051504:0:14903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788917270.051514:0:14903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140831488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917270.051550:0:14903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140831488:12345-0@lo:400:kworker.0 Request processed in 39us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917270.051557:0:14903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788917270.051699:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e2c993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140831488:0@lo:400:kworker.0 00010000:00010000:1.0:1788917270.431330:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917270.797725:0:23373:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917270.797735:0:23373:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917270.798519:0:23373:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917270.798530:0:23373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917271.455304:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917272.197623:0:23424:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917272.197634:0:23424:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917272.198264:0:23424:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917272.198275:0:23424:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917272.455123:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917272.455205:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917272.455236:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917272.455277:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113587456 00000100:00100000:1.0:1788917272.455280:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917272.455290:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113587456 00000100:00100000:1.0:1788917272.455322:0:16200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113587712 00000100:00100000:1.0:1788917272.455325:0:16200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113587712 00000100:00100000:0.0:1788917272.455351:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 194 00000100:00100000:0.0:1788917272.455360:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2371:x1875815113587456:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917272.455364:0:16200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:1.0:1788917272.455371:0:16200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2371:x1875815113587712:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917272.455467:0:16200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2371:x1875815113587712:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 96us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917272.455474:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113587584 00000100:00100000:1.0:1788917272.455479:0:16200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:2.0:1788917272.455481:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113587584 00000100:00100000:2.0:1788917272.455524:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113587840 00000100:00100000:2.0:1788917272.455528:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113587840 00000100:00080000:1.0:1788917272.455544:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788917272.455551:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788917272.455556:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 208 00000100:00100000:2.0:1788917272.455565:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e0a7d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2372:x1875815113587584:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917272.455602:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e0a7d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2372:x1875815113587584:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 38us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917272.455610:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 208 00000100:00100000:0.0:1788917272.455622:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2371:x1875815113587456:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 261us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917272.455635:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 209 00000100:00100000:0.0:1788917272.455640:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 194 00000100:00100000:2.0:1788917272.455648:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e2c993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:2372:x1875815113587840:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917272.455678:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e2c993b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:2372:x1875815113587840:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 34us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917272.455703:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 209 00010000:00010000:1.0:1788917272.480119:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917273.119412:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788917273.119444:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140832128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788917273.119531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917273.119586:0:14905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140832128 00000100:00100000:0.0:1788917273.119596:0:14905:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140832128 00000100:00080000:1.0:1788917273.119644:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788917273.119689:0:14905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788917273.119701:0:14905:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e09919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140832128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788917273.119766:0:14905:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917273.119827:0:14905:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e09919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875815140832128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917273.119836:0:14905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788917273.119877:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875815140832128:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788917273.503236:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917273.514426:0:23475:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917273.514434:0:23475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917273.515040:0:23475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917273.515049:0:23475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788917274.527297:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788917274.844914:0:23526:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917274.844923:0:23526:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917274.845401:0:23526:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917274.845411:0:23526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788917275.167446:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e09918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140832256:0@lo:400:kworker.0 00000100:00100000:1.0:1788917275.167568:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917275.167693:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e3a38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140832384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788917275.167727:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917275.167829:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788917275.167836:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140832768:0@lo:400:kworker.0 00000100:00100000:0.0:1788917275.167862:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917275.167896:0:20500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140832384 00000100:00100000:0.0:1788917275.167916:0:20500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140832384 00000100:00100000:0.0:1788917275.167975:0:20500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788917275.167985:0:20500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140832384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788917275.168030:0:20500:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788917275.168075:0:20500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875815140832384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917275.168082:0:20500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788917275.168125:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e3a38e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875815140832384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788917275.168126:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140832640:0@lo:400:kworker.0 00000100:00100000:2.0:1788917275.168192:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788917275.168202:0:14257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140832256 00000100:00100000:0.0:1788917275.168207:0:14257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140832256 00000100:00100000:2.0:1788917275.168224:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788917275.168234:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6e0991bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140832512:0@lo:400:kworker.0 00000100:00100000:0.0:1788917275.168235:0:14257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788917275.168244:0:14257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140832256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917275.168265:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788917275.168563:0:19544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140832768 00000100:00100000:1.0:1788917275.168567:0:19544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140832768 00000100:00100000:1.0:1788917275.168607:0:19544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788917275.168613:0:19544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140832768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788917275.168645:0:14257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f287850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd2b9984-a8d8-4aee-bfd2-3bebf748d575+19:3304:x1875815140832256:12345-0@lo:400:kworker.0 Request processed in 401us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917275.168651:0:14257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788917275.168762:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140832640 00000100:00100000:2.0:1788917275.168767:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140832640 00000100:00100000:2.0:1788917275.168794:0:14901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140832512 00000100:00100000:2.0:1788917275.168797:0:14901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140832512 00000100:00100000:1.0:1788917275.168824:0:19544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a554a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875815140832768:12345-0@lo:400:kworker.0 Request processed in 209us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917275.168825:0:14901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788917275.168835:0:14901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a38e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140832640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788917275.168835:0:19544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:1.0:1788917275.168857:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788917275.168862:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788917275.168875:0:16665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788917275.168882:0:14901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a38e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140832640:12345-0@lo:400:kworker.0 Request processed in 47us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788917275.168886:0:16665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140832512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788917275.168894:0:14901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788917275.168942:0:16665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1875815140832512:12345-0@lo:400:kworker.0 Request processed in 59us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917275.168945:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e0991bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140832512:0@lo:400:kworker.0 00000100:00100000:1.0:1788917275.168955:0:16665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788917275.168961:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875815140832640:0@lo:400:kworker.0 00000100:00100000:1.0:1788917275.168998:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6e09918700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd2b9984-a8d8-4aee-bfd2-3bebf748d575:3304:1875815140832256:0@lo:400:kworker.0 00000100:00100000:1.0:1788917275.169037:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875815140832768:0@lo:400:kworker.0 00000100:00100000:3.0:1788917275.169393:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140833024:0@lo:400:kworker.0 00000100:00100000:3.0:1788917275.169423:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917275.169451:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140833024 00000100:00100000:3.0:1788917275.169455:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140833024 00000100:00100000:3.0:1788917275.169484:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788917275.169601:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140833024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788917275.169639:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875815140833024:12345-0@lo:400:kworker.0 Request processed in 149us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917275.169645:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788917275.169673:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01ccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875815140833024:0@lo:400:kworker.0 00000100:00080000:1.0:1788917275.169884:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788917275.169943:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788917275.169953:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a6d01ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140832896:0@lo:400:kworker.0 00000100:00100000:0.0:1788917275.169979:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788917275.170081:0:16396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815140832896 00000100:00100000:3.0:1788917275.170086:0:16396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815140832896 00000100:00100000:3.0:1788917275.170123:0:16396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788917275.170130:0:16396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3a557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140832896:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788917275.170223:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788917275.170253:0:16396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3a557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875815140832896:12345-0@lo:400:kworker.0 Request processed in 123us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917275.170259:0:16396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788917275.170331:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a6d01ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875815140832896:0@lo:400:kworker.0 00010000:00010000:1.0:1788917275.551381:0:14253:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788917276.133729:0:23577:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788917276.133740:0:23577:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788917276.134408:0:23577:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:0.0:1788917276.134417:0:23577:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:1.0:1788917276.255363:0:14298:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788917276.255373:0:14298:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788917276.255817:0:14298:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 1 00000040:00080000:1.0:1788917276.255826:0:14298:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788917276.575337:0:16021:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788917277.574696:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917277.574732:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1788917277.574760:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1788917277.574760:0:14258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113587968 00000100:00100000:0.0:1788917277.574769:0:14258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113587968 00000100:00100000:3.0:1788917277.574797:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1788917277.574800:0:14265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113588096 00000100:00100000:1.0:1788917277.574805:0:14265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113588096 00000100:00100000:0.0:1788917277.574821:0:14258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 196 00000100:00100000:3.0:1788917277.574824:0:14264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113588352 00000100:00100000:3.0:1788917277.574828:0:14264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113588352 00000100:00100000:2.0:1788917277.574829:0:14900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875815113588224 00000100:00100000:0.0:1788917277.574835:0:14258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6e3f287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113587968:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917277.574837:0:14900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875815113588224 00000100:00100000:1.0:1788917277.574851:0:14265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 213 00000100:00100000:3.0:1788917277.574892:0:14264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 214 00000100:00100000:1.0:1788917277.574897:0:14265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113588096:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1788917277.574907:0:14264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113588352:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1788917277.574912:0:14900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:0.0:1788917277.574928:0:14258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6e3f287050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a5830ca7-ca02-4e9b-acca-7d0b5e403502+13:2374:x1875815113587968:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 94us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917277.574929:0:14900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6d01ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113588224:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1788917277.574938:0:14265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01ccf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:92610db9-d8ec-4111-b657-7a2541e0ec4f+14:2373:x1875815113588096:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 58us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788917277.574946:0:14264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5ef94afb-c48b-479f-853f-434eacee288c+6:2373:x1875815113588352:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 42us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788917277.574947:0:14258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 196 00000100:00100000:1.0:1788917277.574951:0:14265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 213 00000100:00100000:3.0:1788917277.574963:0:14264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 214 00000100:00080000:1.0:1788917277.574974:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788917277.574979:0:14261:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788917277.574984:0:14900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6d01ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:92610db9-d8ec-4111-b657-7a2541e0ec4f+6:2374:x1875815113588224:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 52us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788917277.575004:0:14900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 125 00010000:00010000:0.0:1788917277.599227:0:14254:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788917277.639389:0:23629:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: request on 0x200000bd1:0x4:0x0 is not SUCCEED on mds1 Debug log: 36056 lines, 36056 kept, 0 dropped, 0 bad.